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TO OUR FATHERS 


IT IS ALMOST ALWAYS GAMBLING THAT ENABLES ONE TO FORM A FAIRLY 
CLEAR IDEA OF A MANIFESTATION OF CHANCE; IT IS GAMBLING THAT GAVE 
BIRTH TO THE CALCULUS OF PROBABILITY; IT IS TO GAMBLING THAT THIS 
CALCULUS OWES ITS FIRST FALTERING UTTERANCES AND ITS MOST RECENT 
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ONE MUST STRIVE TO UNDERSTAND, BUT ONE SHOULD UNDERSTAND IT IN A 
PHILOSOPHIC SENSE, FREE FROM ALL VULGAR IDEAS. 


LOUIS BACHELIER 


PREFACE TO THE DOVER EDITION 


The occasion of this edition provides an opportunity to honor 
the memory of Leonard J. Savage, who suddenly died of a heart 
attack on November 1, 1971. 

Much will certainly be written about Jimmie Savage as a man 
and about Jimmie Savage as a scientist. In this preface, it seems 
appropriate to confine myself to a few of my many recollections of 
our collaboration in the writing of this book. 

Jimmie had already made a wonderful impression on me when 
I was a student at the University of Chicago in the early 1950's. 
He was different from the other mathematicians I had heretofore 
known. He often tested his understanding of the most abstract 
mathematics with colorful, concrete examples that seemed to leap 
instantly and effortlessly into his mind. He was often searching for 
answers, and he shared his thought processes with you. In this 
way, you were his equal, for the search was a joint venture—you 
searched too. But one could not fail to be impressed with his quick- 
ness of mind as well as with the breadth and depth of his knowledge. 

When in June of 1956 I returned to Chicago after a year’s 
absence, Jimmie amazed me utterly by telling me that he had been 
unable to settle the problem of how to play Red-and-Black wisely. 
How could so simple-sounding a problem escape his (and others’) 
immediate solution, I wondered. So I began to think about this 
enticing problem. Little did I then anticipate the delightful con- 
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versations and correspondence that were to develop from that begin- 
ning, nor did I then realize the influence that it was destined to 
have on my own career. But to return to June 1956— 

Within a few days of Jimmie’s telling me of the problem of 
Red-and-Black, I happened to make this trivial observation: if bold 
play is optimal, it is not uniquely so. If I was amazed at learning 
that the problem of Red-and-Black was open, I was even more so 
at Jimmie’s reaction to my all but immediate observation. He was 
so incredulous that he checked, and double-checked—and even at the 
blackboard! He made me feel good about my tiny observation by 
saying that he had always taken the contrary for granted. It was 
his manifest appreciation of that infinitesimal advance that gave me 
the courage to accept his invitation that I work with him. His 
ability to recognize and to appreciate genuinely even the tiniest of 
contributions greatly enhanced my pleasure in working with him 
during the succeeding months and years. 

By the end of the summer of 1956, Red-and-Black was no 
longer an enigma to us. We had shown that bold play was optimal 
(Section 5.11). What launched this book, however, was our mistaken 
confidence that we could, without difficulty, extend our understand- 
ing to the more general problem of primitive casinos (Chapter 6). 
A plausible conjecture was that bold play was again optimal (Section 
6.1). So I (and perhaps Jimmie, too) was shocked when, after we 
had spent more than two years in seeking a proof, Aryeh Dvoretsky 
discovered that bold play was not optimal (Section 6.6), at least if 
playing time is limited. Our—or at least my—confidence in the 
conjecture shaken, we nevertheless persevered and, within a few addi- 
tional months, settled a combinatorial inequality that had stumped 
us for more than two years, and which was all that had remained to 
complete the proof that bold play was indeed optimal for subfair, 
primitive casinos. This was the now innocent-looking inequality of 
Section 6.3 which asserts that certain sequences M are Cartesian. 

Another concrete problem that we found easier to pose than to 
settle was to determine those casinos that are, in a certain sense, 
fair (Section 10.3). We made some progress, were pleased by cer- 
tain mildly surprising observations, and then, were much surprised 
by a discovery of Donald Ornstein (Section 10.2). The main prob- 
lem of giving necessary and sufficient conditions for a casino to be 
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fair was finally solved, mainly by the prodigious efforts of Jimmie 
during the year 1958-59, which he spent in Rome. 

At what point did we break with tradition and develop the 
theory without the countably additive hypothesis? It happened 
essentially thus. In our work on special problems such as Red-and- 
Black, we had, like many others before us (and I mention in par- 
ticular Snell, 1952), used the idea of conservation of fairness, which 
in this book finds important expression in the basic Theorem 2.12.1. 
But it was not until I had heard Aryeh Dvoretsky speak about the 
problem of bold play for primitive casinos (with limited playing 
time) that I began to appreciate the power and generality of that 
idea. I immediately saw the possibilities of a general theorem, and 
established one, but one which applied only to countably additive 
problems, and not even to all such. What was most mystifying and 
puzzling, however, was that it should require, as it did, a prelim- 
inary technical result of moderate difficulty, namely, a measurable 
selection theorem. It was at this point that Jimmie had the daring 
idea, influenced no doubt by his association with Bruno de Finetti, 
that we aim for a general, finitely additive theory. Once Jimmie, 
with some assistance from de Finetti, had persuaded me that we 
were not embarking on totally unjustifiable heresy, we proceeded to 
develop the appropriate mathematics. The main difficulty which we 
encountered was to determine the proper class of functions which 
were to be integrated by strategies, which class turned out to be the 
inductively integrable functions (Theorem 2.8.1). Once that was 
accomplished, the fundamental ingredients to a theory of gambling 
were quickly developed, in particular, the basic Theorem 2.12.1 and 
its companion, Theorem 2.14.1. The finitely additive approach made 
it possible to understand the true, and far less central, role of the 
measurable selection theorem, which theorem now appears later in 
Section 2.16. 

An abstract problem that we raised but did not settle was the 
extent to which stationary families of strategies are adequate. For 
us, it was already a challenge to settle this for various special cases, 
including that in which the fortune space, F, is finite (Section 3.9). 
Many further developments of this problem of stationarity have 
taken place, as a number of entries in the Bibliographic Supplement 
indicate, the most surprising of which is due to Ornstein (1969). 
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It is almost no exaggeration to say that working with Jimmie, 
whether face to face or by correspondence, was always a joy for 
me. His letters were a delight. I chuckled over his humor and 
enjoyed his insights. Our work was accomplished mainly through 
correspondence punctuated by periods together. The letters grew 
into manuscripts which invariably went through several editions. 
The final drafts that Jimmie would write were, for me, a thing of 
beauty. At least once, I undertook to write the final draft of some- 
thing we had done. And I took great pains, much thought and 
much time, until I was totally satisfied that it could not be improved 
upon, not even by Jimmie. But after Jimmie read my draft and then 
wrote his (I do not say “rewrote,” for there was barely any re- 
semblance), my chagrin gradually changed to delight and admira- 
tion at his achievements, both mathematical and expository. 

More than once, Jimmie told me that he considered our work to 
be an important contribution, and that it would be so judged by our 
peers. Perhaps that is why the constant flow of calls upon his time 
and talents did not prevent him from pouring into our joint work 
so much of his energy and genius. Working thus with Jimmie for 
more than three years, it would have been all but impossible for 
anyone not to produce something of interest. 

So, upon coming to Berkeley in 1959—+three years and three 
months after Jimmie had introduced me to the problem of Red-and- 
Black—I was eager to communicate our results and methods, 
especially those mentioned above. It was a pleasure to lecture about 
our work, and to have an interested audience, especially in the per- 
son of David Blackwell, who suggested that we publish our findings 
as a book. At every stage in the writing of this book, Jimmie was 
an artist interested in the quality of every aspect of the book, 
whether it be the elegance of an argument or the appearance of a 
page. Though his example was inimitable, it could not fail to 
make his coauthor a better collaborator. Our efforts were fully re- 
warded with the sense of completion which came with the circulation 
of the mimeographed edition, dated August 28, 1960. 

Each of the subsequent editions, whether mimeographed or 
printed, and this one, in particular, differs but little from the pre- 
ceding. In order to alleviate the present publisher’s concern about 
possible misunderstandings as to the nature of the book, its title and 
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subtitle have been permuted for this edition. The score or so of 
minor mechanical errors that miraculously appeared in the last 
edition—and which were brought to light mainly by the participants 
in a seminar led by Richard Olshen and Jimmie Savage at Yale 
in 1967 have been corrected, of course. More important, this edi- 
tion contains a Bibliographic Supplement. The inclusion of this 
Supplement, unannotated as it is, can merely call attention to recent 
advances. But reading some of the references will, I hope, enable 
the reader to visualize, at least in outline form, the kind of revision 
that might be possible were there alive today my much missed friend, 
Leonard Jimmie Savage. 

L. E. Dusins 
University of California 
Berkeley, California 
August 1975 


PREFACE TO THE FIRST EDITION 


The immediate object of this book, a chapter in the pure mathe- 
matics of probability, is to explore and to share with other mathe- 
maticians certain problems that have excited our curiosity and that 
lead to somewhat novel methods and phenomena. A light introduc- 
tion to these problems is in Chapter 1. 

In spite of the probabilist’s tendency to invoke gambling imagery, 
works on probability have little influence, for good or bad, on the 
gambling man. But probability is not behind other parts of mathe- 
matics in its influence on practical affairs, and this book about theoreti- 
cal problems of how to make the best of a bad and risky situation also 
may eventually lead to applications. 

We have tried to write the book for mathematicians generally. 
Technical knowledge of probability is not a logical prerequisite, except 
for isolated passages, but it will ordinarily be a psychological one. 
No one may be disposed to read the whole book through, so we have 
tried to help skippers and postponers by providing them with signposts. 

We began to ask each other how to play red-and-black in the 
summer of 1956, and this report of our research—in our minds first a 
note, then a paper, and at last a book—has been nearly finished ever 
since. Six written preliminary announcements are (Savage 1957), 
(Dubins and Savage 1960, 1960a), (Savage 1962), and (Dubins and 
Savage 1963, 1965). We also gave talks about the research, particu- 
larly at the following meetings: the Institute of Mathematical Sta- 
tistics at Atlantic City in September, 1957, and at Albuquerque in 
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April, 1962; the American Mathematical Society at Chicago in Jan- 
uary, 1960. 

The flexible system of making references to the Bibliography by 
such expressions as “a book by Doob (1953), “(Doob 1953)”, or 
“(Doob 1953, p. 67)” is familiar and almost self-explanatory. Other 
mechanical matters should also be unobtrusive, but some points may 
be mentioned. 

Technical terms are defined with the aid of italics, which usually 
provide the only signal that a sentence is a definition. The number of 
technical terms and notations introduced is large in spite of economy 
drives, but only a few are in use in any one section and many are short- 
lived. The Subject Index and Index of Symbols will lead promptly to 
a definition that has been forgotten or skipped. 

To illustrate the not unusual system of internal references, ‘‘The- 
orem 2.12.1” denotes the first theorem of Section 2.12, that is, of 
Section 12 of Chapter 2. Within Section 2.12, it is called simply 
“Theorem 1”, and elsewhere within Chapter 2, it is called “Theorem 
12.1”. Similarly, “(2.12.1)”? is the full name of the first displayed 
formula in Section 2.12; the shorter names ‘‘(1)”’ and “(12.1)” are used 
within Section 12.1 and elsewhere in Chapter 2, respectively. This 
system is facilitated by showing a section number at the top of almost 
every pair of pages. 

The mark ‘‘@”’ signifies the end of a proof. 


LESTER E. DUBINS 


LEONARD J. SAVAGE 
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INTRODUCTION 


1. THE PROBLEM. Imagine yourself at a casino with $1,000. 
For some reason, you desperately need $10,000 by morning; any- 
thing less is worth nothing for your purpose. What ought you 
do? The only thing possible is to gamble away your last cent, 
if need be, in an attempt to reach the target sum of $10,000. 
There may be a moment of moral confusion and discouragement. 
For who has not been taught how wrong and futile it is to gamble, 
especially when short of funds? Yet, gamble you must or forgo 
all chance of the great purpose that can be achieved only at the 
price of $10,000 payable at dawn. The question is how to play, 
not whether. 

As is well known, any policy of compounding bets that are 
subfair to you must decrease your expected wealth. Conse- 
quently, no matter how you play, your chance of converting 
$1,000 into $10,000 will be less than 1/10. How close to 1/10 
can you make it and by what strategy? That is the sort of 
problem this book attacks. The particular problems treated 
are highly simplified and idealized, especially when we get down 
to cases, and we do not leave our armchairs far enough to dis- 
cover whether many of them would be applicable in such compli- 
cated situations as obtain for any real gambler. 

The fantasy with which we have introduced the general 
problem of optimal gambling systems has no immediate practical 
importance. But the problem, once proposed, cries out for 
attention as pure mathematics. As such, we have found it 
stimulating and hope you will. 
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2. PREVIEW 


A rough idea of some of the more colorful problems and conclu- 
sions of this book can be imparted quickly. 

Suppose the only kind of gamble available to you in your effort 
to convert a sum of money into a larger target sum is to bet, at fixed, 
subfair odds, on independent repetitions of some fixed kind of event, 
such as drawing a red card or a spade. You are free to choose for 
yourself the amount to stake on each bet, subject only to the restric- 
tion that you can never stake what you do not possess. Under these 
circumstances, one—not usually the only—optimal strategy for you 
is to play boldly; that is, always to stake on each bet either all the 
money in your possession or just enough to arrive immediately at the 
target sum in case you win the bet, whichever of these two stakes 
is the smaller (Sections 5.3 and 6.3). 

If your object is, as before, to reach a target sum and if you are 
free at each play to stake any amount within your means, dividing 
the stake equally among as many numbers on a roulette table as you 
wish, then it is ill-advised to bet on more than one number at a time 
(Theorem 6.9.2). This may be true even if you are free to stake 
different amounts on different numbers simultaneously, but that is 
an open and promising question. 

In games that have several possible outcomes, the gambler does 
not merely lose his stake or win back a predetermined multiple of it, 
as when he simply bets on an event. Instead, he wins back some 
random multiple (quite possibly 0) of the stake that he has deposited, 
so his bet is described as a random variable—his winnings, possibly 
negative—with an essential minimum not less than the negative of the 
stake. A popular index c of unfairness of a bet is the ratio of its 
expected loss to its stake. What can be said about the probability 
of converting a fortune f into the larger target sum 1 if the house 
permits only bets of index at least c? The probability is at most 
1 — (1 — f), which can almost be attained by, for example, repeat- 
edly betting very small stakes on very improbable events at such odds 
that winning one of the bets will bring the gambler at once to the target 
sum 1 (Section 9.3). 

A second index a of unfairness is the ratio of the expected value 
of the loss to the variance. The gambler’s probability of converting f 
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into 1 with only bets of index at least a is at most f/(1 + a — af). 
This bound also is nearly attained by successively placing small stakes 
on the chance of leaping to the goal (Section 9.4). 

A third index of unfairness £ is the ratio of the expected loss to the 
first absolute moment. This index was introduced by Donald Orn- 
stein, who showed that the least upper bound is (1 — 6)f/(1 + 6 — 26f) 
and that it is attained by staking the whole of f on a single chance of 
attaining the goal (Section 9.2). 

When a gambling situation permits you to make fair bets, you 
may be able to reach 1 from f with probability f. In particular, if 
there is available a fair game that you can repeatedly play, choosing 
the stake each time at your own discretion (within your means), you 
“ought”? to be able to reach 1 with probability arbitrarily close to f. 
Surprisingly, though, for each positive e there are fair games that will 
not permit you to reach 1 from f with probability greater than e, as 
was discovered by Donald Ornstein (Section 11.2). 

This book does not consist entirely of the study of such concrete 
and colorful problems, primarily because to formulate and solve such 
problems satisfactorily requires considerable abstraction and generali- 
zation. We came gradually to adopt a certain concept of finitely 
additive, time-discrete stochastic processes as the model of a gambling 
strategy. Since finitely additive measures have not been popular, the 
mathematical fundamentals of such processes had to be explored, and 
this produced some analytic novelties (Chapter 2). The abstract 
formulation, once achieved, suggested abstract questions (Chapters 2, 
3, and 7), and it had to be related to other abstract structures already 
familiar to probability theory (Chapter 12). 

Many concrete problems—in particular, those reported on in this 
section—refer to a moderately general kind of gambling house, here 
called a casino, associated with nonnegative stochastic processes, and 
these problems suggested a theory of casinos of interest in itself 
(Chapter 4). 

Many facts about gambling can be translated with almost no loss 
into the language of stochastic processes. For example, the limita- 
tion on a gambler constrained to use bets for which the expected loss 
is at least œ times the variance says scarcely more than this: If Xo, 
X1, °° * is an expectation-decreasing semimartingale for which 
X» > 0 for all n, Xo < 1, and the conditional expectation of Xn — Xai: 
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given the past is at least a times its conditional variance given the 
past, then Xo/(1 + a — aXo) is an upper bound for the probability 
that sup, Xn > 1. And this bound is sharp. 

In short, one thing has led to another, as happens in mathematics, 
and it is not possible to say satisfactorily in advance what all the 
parts of the book are about. But the introduction of each chapter 
offers additional summary information. 


3. ANTECEDENTS 


Probabilists have been interested in gambling since mathematical 
probability began; so it is surprising that problems like the first one 
mentioned in the preceding section had not been solved, or even much 
discussed. Perhaps moral disapproval has focused so much light on 
those respects in which gambling is futile as to leave other aspects 
of gambling in darkness. 

The idea that large bets are sometimes advantageous for attain- 
ing a fixed goal is in the gambling air. The earliest mathematical 
reference to it that we know is by Coolidge (1908-1909). He studies 
the first problem of the preceding section, generalized to include the 
possibility that there is a legal upper limit to your stake, and purports 
to prove that your only optimal strategy is always to stake the legal 
limit, or all that you possess, or enough to reach the target, which- 
ever is least. The assertion of uniqueness is incorrect. Whether 
that of optimality is correct when there is a legal limit, we do not 
know. We have not seen how to rescue much from Coolidge’s faulty 
demonstration. 

The only other reference we know in this immediate area is a 
passage in which Feller (1950, p. 285, first edition only) comes to the 
not quite accurate conclusion that bold play is uniquely optimal when 
there is no legal limit. 

Knowledge that small bets are contraindicated in certain situa- 
tions is widespread. As De Moivre (1711, Problem IX) and James 
Bernoulli (1713) were quite capable of showing, if you engage in only 
the smallest allowable bets on red-and-black, say $1 or less, you are 
all but certain to lose your entire $1,000 before reaching $10,000. 
An interesting paper by Blackwell (1954) and a sequel to it by Wein- 
garten (1956) can be interpreted as greatly generalizing the method 
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discovered by De Moivre and as treating certain problems about how 
to gamble if you must relatively completely. 

An extension of the recommendation of large bets is the recom- 
mendation of bets for which the variance is large compared with the 
expected loss. This idea goes back at least to de Finetti (1939, 1940), 
whose exposition of it we paraphrase in Section 8.7. Incidentally, our 
work on gambling might never have begun had one of us (Savage) 
not been intrigued by hearing of this rule indirectly through Jesse 
Marcum. De Finetti’s papers (1939, 1940) are also descendants of 
De Moivre’s Problem IX. 

One very important idea about gambling strategies permeates 
the whole history of probability. It might be called the ‘‘conservation 
of fairness”, and it says that any combination or concatenation of bets 
that are at most fair, when viewed as a single, composite bet, must 
be at most fair. For example, De Moivre takes the conservation 
of fairness for granted in his Problem IX, and we find it our most 
important tool. 

Bachelier (1900, 1912, 1914, 1938) deliberately makes the con- 
servation of fairness central to his theory of speculation in stocks and 
commodities. This work is apparently the oldest sustained study 
of continuous-time stochastic processes. As we have heard it put, 
Brownian motion, a gem of modern physics, is a botanical discovery 
the mathematical theory of which originated in the social sciences. 

Some formulations of conservation of fairness in the measure- 
theoretic framework date from (Halmos 1939). These are carried 
forward in Doob’s (1953) treatise on stochastic processes. 

While we were working on this book, which is largely motivated 
by unfavorable games, Leo Breiman was independently working on 
how to get rich quick at favorable games. His interesting paper 
(Breiman 1961) and this book complement each other. 

When the theory of gambling systems is viewed very abstractly, 
it tends to merge, in principle, with the theory of sequential decisions 
and with the general idea of dynamic programming, a broad concept 
of strategy optimization developed by Bellman (1952, 1957). The 
relation of the theory of gambling strategies to dynamic programming 
and to the establishing of inequalities for stochastic processes is 
discussed in Chapter 12. 


2 
FORMULATION OF THE 


ABSTRACT GAMBLER’S 
PROBLEM 


1. INTRODUCTION. This chapter defines gambler’s problems 
abstractly and demonstrates some properties of theirs that go a 
long way toward solving the relatively specific cases in later 
chapters. The abstract formulation is not very hard to compre- 
hend, and we believe that it helps bring out the essence of many 
arguments, that it is of some interest in itself, and that it may 
stimulate future work. Some general questions that logically 
pertain to the abstract formulation are postponed to later chap- 
ters (3, 7, and 12) so that you may more quickly meet the con- 
crete cases that originally stimulated our own interest and enliven 
the general theory. 


2. FORTUNES AND HISTORIES 


A gambler begins with a fortune fo, and as play progresses 
. he moves successively through a sequence of fortunes fi, fo, °° ° 

A fortune might well be simply a sum of money in the posses- 

sion of the gambler, and in the examples in most later chapters 
(4, 5, 6, 8, 9, 10, and 11) it can be so interpreted. There are, 
however, much more general possibilities of interest, which wil 
be explained in Chapter 12; for “fortune” is so conceived that the 
entire worth of a situation, which means the range of choice (that 
is, the set of gambles) open to the gambler in making his next 
7 
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gamble, as well as the value to the gambler of what he will 
possess if he now ceases gambling, is a function of his present 
fortune alone. The generality envisaged is so great that the 
word “state”? might be more appropriate for this chapter, but ‘‘fortune”’ 
is more suggestive for the concrete problems of later chapters. The 
purpose of this chapter and the next is to present that part of a mathe- 
matical theory of gambling which is general enough to embrace any 
space of fortunes. In Chapters 7 and 12 there is some additional 
general theory. 

Let F, an arbitrary nonempty set, be the set of all fortunes and H 
the set of all sequences of fortunes, that is, the set of all histories, 
h = (fi, fe, >> *). In our conventions, fo does not belong to the 
history; it is “prehistoric”. 


3. GAMBLES 


A gamble is, of course, a probability measure y on subsets of 
fortunes. In the tradition of recent decades, such a measure would 
be defined only on a sigma-field of subsets of F and required to be 
countably additive on that sigma-field. 

If this tradition were followed in this book, tedious technical 
measurability difficulties would beset the theory from the outset. 
(To see this kind of potential difficulty, formulate mathematically 
the problem corresponding to that of a gambler with an initial fortune f 
who desires to maximize the probability that his fortune at the end 
of two gambles will be in a certain subset of the unit interval, where 
for each g in the interval there is a set I'(g) of countably additive 
gambles defined only on the Borel subsets of the interval.) Experience 
and reflection have led us to depart from tradition and to assume that 
each y is defined for all subsets of F and not to assume that y is neces- 
sarily countably additive. This departure is further explained and 
justified in the next paragraphs. 

The assumption that y is not defined for all sets would, all in all, 
complicate this chapter; the restriction to countably additive gambles 
would weaken its conclusions. Some of the new problems that the 
finitely additive approach does introduce are of mathematical interest 
in themselves. 

When a gamble is specified in practice—even in the most mathe- 
matical practice—the specification will often define the value of the 
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gamble only on some subclass of the class of all sets, perhaps on a 
Boolean algebra. For example, it might be specified that a certain 
gamble coincides with Lebesgue measure for the Lebesgue-measurable 
subsets of the unit interval. It is therefore essential to handle prob- 
lems in which the gambles are not defined for all subsets of fortunes. 
One way to do this, suggested by tradition, is to carry a concept of 
measurability and integrability throughout the discussion, exploring 
the integrability of various functions that arise as candidates for 
integration, and to discuss upper and lower (or outer and inner) 
integrals when nonintegrable functions do arise. 

A seemingly equivalent and, we find, much simpler method of 
handling problems where gambles are defined only on a subclass of 
sets is to consider all extensions of each such incompletely defined 
gamble to the class of all sets of fortunes. According to the Hahn- 
Banach theorem, such extensions exist in abundance, though in a 
very nonconstructive sense. If, for example, the gambler starting 
from $1,000 can reach $10,000 with probability .07 in every completion 
of an originally incompletely defined problem, is it not a sensible 
interpretation to credit him with at least that much in connection 
with the problem as originally specified? Likewise, if there is some- 
thing he cannot achieve (or approach) under any extension, it ought 
not be regarded as achievable in the original problem. Finally, if 
something can be approached for some extensions but not for others, 
then the original problem must be recognized as not sufficiently 
specified to yield a definite answer. 

The traditional extent of specification is, as might be expected, 
often found to be adequate. For instance, in many interesting cases 
of a gambler intent upon maximizing the probability of converting 
a given initial cash fortune into a specified larger one, it is irrelevant 
how the gambles are defined on non-Borel sets, or even non-Jordan 
sets (Corollaries 4.6.1 and 8.2.5). Even if the space of fortunes is not 
an interval of real numbers, a general theorem in Section 2.16 paves 
the way for a theory of gambling consonant with the traditional theory 
of probability, but less general than the one set forth in some detail 
in this chapter. 

With these explanations in mind, we make everywhere-defined 
gambles the main object of our formal study and use them as the 
convenient tool for studying the less completely defined gambles that 
are the more practical objects of interest. 
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De Finetti (1930, 1937, 1949, 1950, 1955, 1955a) has always 
insisted that countable additivity is not an integral part of the prob- 
ability concept but is rather in the nature of a regularity hypothesis; 
his papers (1949) and (1950) are more particularly concerned with the 
conceptual aspects of this question than are the others cited; (1955) 
and (1955a) are mathematical papers about finite additivity. Per- 
sonal contact with de Finetti gave us the courage to break with the 
traditional restrictions of countable additivity and to view countably 
additive measures much as one views analytic functions—as a par- 
ticularly important special case. 

We believe that anyone familiar with countably additive measure 
will need no special preparation to understand the aspects of finitely 
additive measure that arise in this book. One who does wish to see 
an explicit development of finite additivity in English can turn to 
(Dunford and Schwartz 1958, Sections 1 through 3 of Chapter III, 
and notes and remarks, p. 233). 

One of the many ideas that is as applicable in the finitely additive 
theory as in the more special countably additive one is that of ‘‘com- 
pleting”’ a partially defined measure or integral y. Of course if ¢; and 
$: are integrable under y with ¢1 < ¢z, then f ¢i1dy < f ¢2 dy; that is, 
y is order-preserving. There are usually many ¢ to which y can be 
extended so as to remain order-preserving. To ‘‘complete” y is to 
extend it to those ¢ to which it has only one possible extension, namely, 
those whose upper and lower integrals are equal. Since the idea of 
completing a measure space does not appear to be different from ‘‘the 
method of exhaustion” often attributed to Eudoxus, we call the result 
the Eudoxus extension to distinguish it from further extensions. The 
linearity and the order-preserving character of the integral determine 
the value of f ¢ dy for a large class. In the event that y is defined 
on all subsets of F, this class includes all bounded ¢. 

Besides those of primary interest for this book, there are other 
reasons for pursuing the study of finitely additive measures. To men- 
tion but one, sometimes the only natural measure is not countably 
additive. A natural and intuitive example that does not yet seem to 
be in the literature is this. There is one and only one translation- 
invariant probability measure defined on the Boolean algebra gen- 
erated by the arithmetic sequences. Under this measure, the set 
{- - + , —2n, —n,0,n, 2n, - - -} is necessarily assigned a probability 
of 1/n. An obvious relation between this measure and the more 
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familiar notion of the (long-run) density of a subset of the integers 
is this: The upper and lower densities of a subset are between the 
upper and lower measures. Nathan Fine has told us interesting 
number-theoretic facts, not yet published, that have flowed from his 
study of the completion of this measure. Another finitely additive 
measure, suggested by de Finetti, is one that assigns to every interval 
of rational numbers the distance between its endpoints. Any prob- 
ability measure that assigns probability 1 to some countable set, but 
probability 0 to every finite set, will be called diffuse. 


4. GAMBLING HOUSE 


The gambling house is, in effect, a function T that associates 
with each f a nonempty set ['(f) of gambles y among which the gam- 
bler is allowed to choose when his fortune is f. The function T thus 
describes the environment in which the gambler plays. Often, the one- 
point gamble 6(f) is in r(f) for all f. 


5. STRATEGIES 


The gambler, constrained by his initial fortune fo and subject 
to the rules imposed by the gambling house Tr, must decide how to 
play; he must choose one among all available strategies. Just what 
is a strategy? How wide is the domain of the gambler’s choice? 
Loosely, a strategy ought to be a rule—not necessarily a good one— 
specifying what gamble the gambler is to choose in every possible 
contingency. 

Formally, a partial history p is a finite (possibly vacuous) sequence 
of fortunes (fı, - - - , fa), and a strategy is a function o associating a 
gamble o(p) with each partial history p. Equivalently, a strategy 
o iS a sequence go, c1, © © > , where co is a gamble, and for each positive 
Nn, cn iS a function that associates with each finite sequence of fortunes 
(f1, ©- , fa) a gamble o,(fi, © © © fa). For each subset A of F, 
on(fi, © © © ,fn)A is, conceptually, the conditional probability under o 
that frr1e¢ A given fi, © ©, fn. 

The gambler with the strategy « who has experienced the partial 
history p continues gambling according to the conditional strategy olp], 
where o[p](p’) is the gamble o(pp’) associated by o with the par- 
tial history pp’, namely the finite sequence p followed by the finite 
sequence p’. 
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The strategy conditional on a one-fortune partial history p = (f) 
is naturally abbreviated from o[(f)] to o[f]. Thus each o determines 
a gamble o> and a family of strategies o[f]; and each gamble y and 
family of strategies, or strategy-valued function of f, ¢ determine the 
strategy of which op = y and o[f] = a(f). 

The house T and the gambler’s initial fortune f limit his range 
of choice of strategy. Formally, o is available in T at f if oo ET(f) 
and on(fi, © © © , fn) €T (fn) forn > 1. 

Obvious theorems like the following will often be stated without 
proof or comment. 


THEOREM 1. Ifo is available in T at f’, then, for every f, the 
strategy o[f] is available in T at f. 


The technical concept of strategy adopted here is incomplete 
as a formulation of a full policy of behavior on the part of the gambler. 
It leaves out of account the idea that the gambler must, sooner or 
later, decide to stop playing. One possible program for introducing 
this feature is to confine attention to strategies for which e, is almost 
sure to be a fixed, one-point measure for sufficiently large n. We 
have found it more convenient to study all strategies and to combine 
a strategy with a stop rule to form a policy (in Section 9). One 
advantage of defining a policy to consist of a strategy together with a 
stop rule, rather than restricting attention to strategies that stagnate 
almost surely, is that in some problems the simplest strategies (and 
sometimes the only ones) that have a claim to be called optimal 
are not almost sure to stagnate but have to be arbitrarily terminated 
by a stop rule; there is a natural example in Section 11.6. 


6. THE INTEGRAL GENERATED BY A STRATEGY 


With respect to a strategy co, it ought to be meaningful, according 
to the intended formulation, to ask, for example, for the probability 
that at least 3 of the first 17 fortunes fall in some subset of the set 
of all fortunes or (when the fortunes are positive integers) for the 
probability that the fıst coordinate of the history h exceeds fı, that is, 
for the probability that fy, > fı» In particular, ø is intended to induce 
a certain probability measure, or integral, at least on bounded func- 
tons g of h that depend on only a finite number of coordinates of 
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h, namely, 


(1) 


og = [| -- + [ogofa > tn) donafulfa «+ +s fot) 
X - - + doi(fel fı) doo(fi). 


In ordinary parlance, og is the expected value of g under oc. 


Note that the symbol “s” is now being used both for a strategy and 
for the integral induced by it. Two nominally different strategies c 
and o’ can induce the same integral if, for example, co = oj and 
o[f] = o'[f] for almost all f with respect to ao. 


The definition (1) does not go.far enough to meet our intentions 


or our needs. 


(2) 


Example 1. Let F be the positive integers, and let g(h) be 1 or 0 
according as the fst coordinate of h, namely f;,, is odd or even. 
Since g(h) depends on only the first and fist coordinates of h, g(h) 
may be written as g(fı, fr). In evident notation, cg ought to be 


og = | olfilg(t: fn) doh), 


where the meaning of the integrand for each fı is given by (1). 
But (1) alone cannot deliver this conclusion, since g is not deter- 
mined by any finite number of coordinates of h. Still more, 
it may not be possible to approximate g usefully from above and 
below by functions that are so determined. For suppose that gx 
and g* depend on only the first m coordinates of h and that 
ge <g<g*. Plainly, g(h) <O and g*(h)>1 if fi >m. 
Therefore, according to (1), if oo is a diffuse gamble, then og < 0 
and og* > 1. But og as defined by (2) can, depending on the 
family o[f:], have any value in [0, 1]. Thus (1) cannot deal with 
this g even through the technique of Eudoxus completion. For 
the lower integral cg is at most 0, and the upper integral o*g is at 
least 1, so g is not Eudoxus integrable. 


For each fortune f and history h = (fi, fe, © © -), let fh denote 


the history (f, fı, fe, © © *). Each g defined for all h gives rise to a 
family of functions gf, one for each f, defined for each history h thus: 
gf(h) = g(fh) = g(f, fu fe, - <- *). In the spirit of (2), it would be 
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tempting to evaluate og by 


(3) og = | olfilafs doo(f.), 


whenever gf; is, for each fi, the kind of function of h whose expecta- 
tion under c[fı] has already been defined. Thus (3) is promising if, 
for each fı, gfı depends on only a finite number of coordinates, etc. 
The ‘‘etc.”’ is a little delicate; a section must be devoted to its explora- 
tion before the hope expressed in (3) can be fulfilled. 


7. FINITARY MAPPINGS 


Much of the content of this section is already to be found in 
(Kalmár 1957). 

The functions g of h that depend upon only a finite number of 
coord nates of h play an important role in mathematics and will here 
be called functions of finite structure. For many purposes, however, 
this family is too small. In particular, as has just been seen, the 
real-valued functions of finite structure are inadequate as the domain 
of definition of the integral s. 

Countably additive experience brings to mind the smallest family 
of functions that contains the real-valued functions of finite structure 
and is closed under pointwise limits; but this family is ill suited to 
the more general finitely additive theory of integration. The present 
section discusses a different natural family of functions that is much 
richer than the family of finite structure and is well suited to finitely 
additive integration. 

For each mapping g of H into any set R, gf is, as in Section 6, the 
mapping of H into R defined by gf(h) = g(fh). 

Call a family G of mappings of H into a set R finitarily closed if 
geG whenever gf EG for all f in F. Call the smallest finitarily 
closed family G of mappings of H into R that contains the constant 
functions the finitary mappings. To put it a little differently, g is a 
finitary mapping of H into R if every finitarily closed family of map- 
pings of H into R that contains the constant mappings contains g. 
Several useful characterizations of finitary mappings will now be 
developed. 

A mapping g of H into R has structure 0 if g is a constant. For 
each ordinal a greater than 0, g has structure at most a if, for each f in F, 
there is an ordinal £ less than a for which gf has structure at most £. 
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If, for some a, g has structure at most a, g is structured. If g is struc- 
tured, let a(g) be the first ordinal a for which g has structure at most a, 
and call a(g) the structure of g. Clearly, a(g) = [sup a(gf)] + 1 or 
sup a(gf) according as sup a(gf) is or is not attained or, equivalently, 
according as a(g) is or is not the successor of an ordinal. 

If F conta‘ns only one element, every g is of structure 0. If 
F contains a finite number of elements, but more than one, there is a g 
of every finite structure a but no g of infinite structure. If F is 
infinite, any a that does not exceed F in cardinality can occur as a 
structure, but no others can. 

It was justifiable to call a g that depends on only the first n 
coordinates of h of finite structure, as we did, since such a g clearly 
has structure at most n for the finite ordinal n. 

When should a mapping of H into R be called continuous? 
Since F and R are introduced here simply as abstract sets, the discrete 
topology (the topology in which every subset is open) is the only 
topology that suggests itself for them. But for H it is natural to 
introduce the Cartesian-product topology corresponding to the dis- 
erete copies of F of which H is the Cartesian product. That is, a 
subset S of H is open if, and only if, for every history h in S, there is an 
n such that every history h’ which agrees with h in the first n coordi- 
nates is also in S. A mapping g of H into R is, then, continuous if 
and only if g—1(A) is an open subset of H for every subset A of R. 
Equivalently, g is continuous if and only if g—1(A) is both an open and 
a closed subset of H for every subset A of R. 

A mapping g of H into R is determined if, for every h, there is an 
n such that g(h’) = g(h) for every history h’ that agrees with h in the 
first n coordinates. Let n,(h) be the smallest such n, possibly 0, 
and say that g is determined at (time) n,. Clearly, n, is itself a deter- 
mined function and is determined no later than g, that is, nan, < ng. 

We are indebted to conversation with John Myhill for the topo- 
logical aspect of the following characterization theorem. This aspect 
is the point of departure for (Kalmár 1957). 


THEOREM 1. The following four conditions on a mapping g of H 
into R are equivalent. 

(a) g is finitary. 

(b) g is structured. 

(c) g is continuous. 

(d) g is determined. 
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Proof: 


(a) implies (b): The set of structured g’s contains the constants 
and is finitarily closed. 

(b) implies (c): The functions of structure 0, the constants, are 
certainly continuous. Suppose that all functions of structure less 
than a are continuous, and consider a g of structure a. Then gf is 
continuous for each f. That is, for each f and h, there is an n such 
that, if h’ agrees with h through the first n coordinates, then gf(h) = 
gf(h’). Therefore g(fh) = g(fh’), where fh’ is any history that agrees 
with fh in the first n + 1 coordinates. Thus g is continuous. 

(c) implies (d): Obvious. 

(d) implies (a): Suppose that some determined g is not finitary. 
Then, for some fı, gf: is not finitary, and so, for some f2, gfife is not 
finitary. This generates an infinite sequence h = (fi, fe, © © -) such 
that gfı - - > fa isnot finitary for any n. Then for no n is gfı © © + fa 
constant, contradictory to the assumption that g is determined. @ 


A set of histories is a finitary event if the indicator of the set is a 
finitary function. (The indicator of a set is, as usual, the function 
that is 1 on the set and 0 off the set.) 


COROLLARY 1. An event is finitary if and only if it is a closed 
and open subset of H. 


(In the study of sets of sequences of integers it is usual to construct 
various hierarchies beginning with the closed, open sets, such as 
Baire’s classification of the Borel sets (Sierpinski 1950), (Liapunov, 
Schegolkow, and Arsenin 1955), and (Addison 1958). As early as 
1930, Lusin (1930, p. 85) classified the closed, open subsets of the 
irrationals into a hierarchy beginning with the null set and the set of 
all irrationals similar, if not isomorphic, to the hierarchy of closed, open 
sets of sequences implicit in (Kalmár 1957).) 


If F is a finite set, the finitary functions are relatively limited in 
structure. 


THEOREM 2. If F is finite and g is finitary, then g is of finite struc- 
ture and assumes only a finite number of values. 


Proof: Immediate from the definition of finitary. @ 
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Finitary or, equivalently, determined functions can be very freely 
combined. 


THEOREM 3. If gi, >- , 9, are determined, the k-tuple (gi, -- - , gx) 
is itself a determined function, determined at the maximum of the 
times at which the g; are determined. 


THEOREM 4. Any function of a determined function g is deter- 
mined no later than g. 


8. INDUCTIVELY INTEGRABLE FUNCTIONS 


A bounded, real-valued, finitary function is called inductively 
integrable. The next theorem partially justifies this term and fulfills 
the program of definition of the integral e begun in Section 6. 


THEOREM 1. There is one and only one function E defined on all 
pairs (c, g), where o is a strategy and g is an inductively integrable 
function, such that E(c, c) = c for every constant c and 


(1) E(, 9) = | Eletfil, gfi) doo(f.). 


Proof: An E will be defined inductively, checked, and shown to 
be unique. 

If g is of structure 0, it is a constant c. Let E(e,c) =c. IFE 
has been so defined for all o and for all bounded g of structure less 
than a that |E(c, g)| < sup |g], let E(c, g) be defined for a g of structure 
a by (1). This is an unambiguous definition covering g’s of every 
structure a and, therefore, all inductively integrable g’s. So defined, 
E(c, g) plainly satisfies the condition of the theorem. Finally, it is 
easy to see by induction that no other function does. ¢@ 


Usually, E(c, g) will be abbreviated to og. This is in harmony 
with the definition (6.1) already given for functions of finite structure, 
and the integral c has the linearity and positivity appropriate to a 
probability integral. These facts are easily checked, mainly by induc- 
tion, and are here recorded. 
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THEOREM 2. Ifo is a strategy, g and g’ are inductively integrable, 
and c and c’ are constants, then: 

(a) If g =c,og =c. 

(b) If g is of finite structure, (6.1) applies. 

(c) (6.3) applies. 

(d) cg + c’g’ is inductively integrable. 

(e) oleg + c’g') = cog + c’aq’. 

(F) If g = 0, og => 0. 


For the main purposes of this book, og has now been defined 
for an adequate domain of g’s, but as with any nonnegative measure, 
the Eudoxus extension can be defined and is likely to prove useful. 
Any bounded function g of histories exceeds some inductively inte- 
grable functions and is exceeded by others. Let E*(c, g) and E;(c, g) 
be the upper and lower integrals of g with respect to c. 

If, for some o and g, E*(c, g) and Ex(c, g) are equal, g is integrable 
under c, and the domain of definition of E can then be extended by 
letting E(c, g), or its abbreviation og, be Ex(c, g). When it is desired 
to call attention to the possibility that an integrable g is not induc- 
tively integrable, g is called Eudoxus integrable under o in harmony 
with a definition in Section 3. 


THEOREM 3. If gf is (Eudoxus) integrable under o[f] for every f 


and if g is bounded, then g is (Eudoxus) integrable under o and (1) 
holds. 


The import of Theorem 3 is that (after Eudoxus extension) E 
cannot be extended to more bounded functions by (1). The converse 
of Theorem 3 does not hold. But a strengthened form of Theorem 3 


has a converse, as the next theorem, preceded by a lemma, asserts. 


LEMMA 1. For all strategies c and all bounded functions g, 


(2) E*(o,g) = | E* (elf), gf) doo), 


and 


(3) Bx(o,9) = | Eslolf], af) doo). 
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THEOREM 4. A bounded function g is integrable under o if and 
only if 


(4) f B*Cctfl, gf) dolf) = | Ex(otfl, gf) doo(f). 
In this event, E(c, g) equals (4). 


As with any probability integral, c can be viewed as a probability 
measure defined on those subsets M of H that have integrable indi- 
cator functions; cM, the probability of M under ø, is defined as the 
integral with respect to o of the indicator function of M. If M is 
finitary, the indicator of M is even inductively integrable. When it 
seems desirable to note that the Eudoxus integral is invoked, oM is 
called the Eudoxus measure of M. 

(In addition to the general technique of extending any integral to 
some unbounded functions in terms of the behavior of their truncations 
(as will be reviewed and used later), a special technique suggests itself 
in the case of strategies. For example, if gf is integrable under o[f] for 
each f, and if E(o[f], gf), as a function of f, is integrable with respect to 
oo, then (1) suggests the value for E(c, g), even if g is unbounded, etc.) 

The next theorem and its corollary help to bring out the meaning 
of integration with respect to ø, though they are not applied in this 
book. The theorem is not difficult to prove, especially with tech- 
niques in the next section and in Section 3.2. 


THEOREM 5. For a bounded g, the following conditions are 
equivalent: 

(a) g is Eudoxus integrable under every strategy o. 

(b) For every history h and positive e, there is an n such that if 
h’ agrees with h at the first n coordinates then |g(h) — g(h’)| < e. 

(b’) g is continuous from the product topology on H to the ordi- 
nary topology on the real numbers. 

(c) For every positive e there is an inductively integrable g’ such 
that |g — g’| < e. 

(c’) g is the uniform limit of a sequence of inductively integrable 
functions. 

(d) gf is Eudoxus integrable under every c for all f. 


In the light of Theorem 5, Theorem 2 is valid for the class of 
functions that are integrable under all ø. 
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COROLLARY 1. M has a Eudoxus measure for all strategies o if 
and only if M is a finitary event. 


Countably additive counterparts of ideas from this and the pre- 
ceding two sections have been explored by J. P. Raoult (1964a). 


9. STOP RULES, POLICIES, AND TERMINAL 
FORTUNES 


As we define it, the policy of a gambler is not specified by o alone. 
There must also be a stop rule, a positive integer ¢(h) assigned to 
each history h, expressing the gambler’s decision to terminate play 
after the ¢(h)th move and to accept fi) as his terminal fortune. Stop 
rules are familiar in the theory of games, statistics, and the theory of 
probability. Formally, a stop rule is a mapping t from H to the posi- 
tive integers such that, if h’ agrees with h through the first t(h) coordi- 
nates, then i(h’) = t(h). And a policy r is the pair (c, t); m is available 
nT at f if ois. 

This definition of policy does not cover the possibility that the 
gambler will elect to settle for his initial fortune without gambling 
at all. Expressing this liberty in terms of a policy has always led 
us into technical annoyances. However, the gambler can ordinarily 
produce the effect of terminating without gambling by letting his first 
gamble op be the one-point measure 6(fo) and letting ¢ be identically 1. 

A stop rule is determined in the sense of Section 7; in fact, t is 
evidently determined by time ¢ at the latest. It is therefore finitary 
and continuous, and has a structure a(t), according to Theorem 7.1. 

The following is essentially a famous and simple theorem of 
König (1936, Theorem 6, p. 81). 


THEOREM 1. If F is finite, every stop rule is bounded. 


Proof: Since every stop rule ¢ is determined, Theorem 7.1 
applies to show that it is finitary. Theorem 7.2 then implies that it 
is bounded. 


It may seem too strict to require the gambler to terminate every 
history. Would it not be enough to require him to terminate almost 
certainly? This question will be explored as soon as is practical (in 
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Section 11), when almost-terminating policies will be shown to offer 
no material advantage to the gambler. 

Associated with each stop rule ¢ is an important mapping of H 
into F, the terminal fortune fı, which is, for each h, the t(h)th coordinate 
of h; that is fi(h) = faa). 

Had we insisted on allowing termination before the first gamble, 
that is, allowing ¢ to be 0, then f, would, in such a case, be undefined. 
To define it as fy and reckon fo as part of the history replaces the con- 
cept of a strategy, in effect, by that of a family of strategies and 
eliminates a small technical annoyance at the price of a larger one, as 
would leaving f: undefined when ż is 0. 

If every coordinate of h is f, then fe = f; so f; takes all values in F. 


THEOREM 2. The function f; is determined. Aside from the 
uninteresting possibility that F contains but one element, f, is deter- 
mined exactly at time ¢; that is, nj, = t. 


Intuitively: There is no forecasting with certainty, at any time 
before t, what fortune the gambler will possess when he stops. By 
contrast, the time ¢ of stopping is sometimes decided before stopping 
occurs. For example, ¢(h) might be 25 for all h so that the structure 
of t would be 0. 

Proofs by induction often involve functions f,f derived from fe: 
In accordance with Section 7, f:f(h) = f:(fh) forall h. Since tis a stop 
rule, either if = 1 or else tf is never 1. In the latter case, tf — 1 
is itself a stop rule é[f]. As is easy to verify, 


(1) ae | if if =1 


= fi iy} otherwise. 


Intuitively: The gambler finds himself at f after his first gamble 
oo; he stops then and there if tf = 1; otherwise he stops later—when 
and where being governed by a new stop rule ¢[f] = tf — 1. Some- 
times the notation i[f] is used for tf — 1, even when éf — 1 is 0 and, 
therefore, technically not a stop rule. 


THEOREM 3. If ¢[f] is a stop rule and F has at least two elements, 
then the structure of fap is strictly less than that of f, For any t, the 
structure of f: is at least that of t. 
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If a gambler follows a policy 7 = (ø, t) until it terminates after 
some partial history p = (fi, - - - ,f,) at the fortune fa, and if he 
then resumes gambling according to a policy 7r’(p), he is, in effect, 
adopting a composite policy t”. With respect to r”, 7’(p) represents 
the conditional distribution of the behavior of the gambler given 
that he has experienced p up to time ¢t. The next three paragraphs, 
which are used only occasionally and can be skimmed or deferred, 
present this somewhat technical notion formally. 

Let h” = (fn+1, fa+2, © © *) denote the part of the history h after 
time n. Thus h?™ = (fit+, fit+, © > *) is the part of h after t(h). 
Similarly, let p:(h) = (fı, © © © , fecny) be the part of h up to and includ- 
ing t(h). The composition of a stop rule ¢ with a family of stop rules 
t’(p), one for each partial history p, means the stop rule t” that con- 
tinues beyond ¢ according to ¢t’(p:(h)); 


(2) t’ (h) = t(h) + t(pi(h) (hi). 


There is no fundamental reason why ¢’’(h) should not be allowed to 
equal t(h) for some, or all, histories h, contrary to the convention 
adopted earlier according to which t’(p) cannot be 0. But the addi- 
tional freedom would ordinarily be of no material advantage and would 
entail some additional complication. 

Consider a gambler who pursues a policy r = (e,t) until it 
terminates after a partial history p and who then continues according 
to a family of strategies o’(p). In effect, he composes the strategy 


11 11 
o” = (0, Ci; >? -), where 


On( fi, pe y Jn) forn < i(h), 
B) off ++ fa) = (ieia forn = th), 
Tnt (De(h)) (fini a , fa) forn > t(h). 


Formally, the policy r followed by the family of policies r’(p) is the 
composite policy t” = (c”, t”). 

The policy r = (e,t) is largely tantamount to the distribution 
of f: under cø, that is, to the gamble y(r) for which y(r)E is, for each 
subset E of F, the probability under o that fec E. In terms of y(r), 
the gamble induced by r, 


(4) vaw = yle, tv = | oS) dra) 
= f v(f(h)) dolh) 


Sec. 9] Stop rules, policies, and terminal fortunes 23 


for any bounded function v of fortunes. Of course v(f:) is a finitary 
function of h (Theorems 2 and 7.4) and is therefore inductively 
integrable. 

Just as a policy r induces a distribution y(r) on fortunes, defined 
in terms of the mapping h into fi(h) = fiin), it also induces a distribution 
n(x) on partial histories p, defined in terms of the mapping of h into 
p.(h). Since p: is a determined function to partial histories, w(p,(h)) 
is inductively integrable for all bounded functions w of partial histories, 
and 


(5) nlr)w = n(o, tw = | w(p) dnl) (p) 
= f w(p.(h)) doth). 


If r” is the policy r followed by the family of policies r’(p), then 
(6) yaw = | y(n’(p))v dn(x)(P), 


as is not hard to verify. 

In some applications, 1’(p) depends only on the final element fn, 
say f, of p. Then 7’(p) can advantageously be written 7’(f), and (6) 
specializes essentially to 


(7) yaw = | rS dya). 


A brief and light digression on the generation of new stop rules 
from old ones concludes this section. If ¢ is a stop rule and ¢ maps 
the positive integers into themselves, then ¢(t) may or may not also 
be a stop rule. For example, t? is a stop rule, but the largest integer 
not exceeding 1/2 typically is not. Which are the ¢ that transform 
all stop rules into stop rules? Among them are certainly those for 
which (i) > 7 for all positive integers 7. The only others are those 
which, for some positive k, satisfy 


(8) MORR fori < k 
=k for i > k. 


With the convention that k can be œ, (8) characterizes the ¢ that carry 
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stop rules into stop rules. What integral-valued functions y of two 
integral variables carry each pair of stop rules into a stop rule? Just 
those for which y(i, 7) satisfies the condition (8) in z for each 7 and 
in j for each 7. Examples are: min (2,7), max (i,j), t + j, and 7. 
The principle extends immediately from two to any number of argu- 
ments, finite or infinite. 


10. THE UTILITY OF FORTUNES, POLICIES, 
AND HOUSES 


How are the gambler’s desires or aspirations to be described 
mathematically? For most of the concrete problems in this book, 
the description is very simple: Some fortunes are satisfactory and 
others are not; the gambler seeks to maximize the probability of 
terminating play at a fortune that is satisfactory. With no extra 
trouble, and with some advantage, a more general and realistic model 
of the gambler’s desires is adopted. Namely, it is assumed, in 
accordance with much current theory about behavior in the face of 
uncertainty, that the gambler’s desires are summarized, in a certain 
sense, by a function u from fortunes to real numbers, called the utility 
function. The worth or utility of the fortune f to the gambler is u(f). 
If the gambler’s only objective is to cease gambling with a numerical 
fortune as large as f’ if possible, then u(f) can be taken to be 0 or 1 
according as f is or is not exceeded by f’. 

This book is not confined to such two-valued utility functions, 
because the general function seems natural to the theory and proves 
to be a useful tool in the study of two-valued utilities. (For back- 
ground about the theory of utility see Chapter 5 of (Savage 1954) and 
references cited there.) In order to avoid distracting complications 
we shall, with casual exceptions in Chapter 12, assume u to be bounded. 

In many mathematical studies of gambling and insurance, the 
“gambler” is interested in maximizing his expected cash, in which 
case cash—which is not necessarily bounded—is identified with utility. 
This utility function is often tacit when it is said that gambling in a 
commercial gambling house does not pay. 

According to the intended interpretation of utility, the gambler 
will value a policy r according to the expected value under r of the 
utility of its terminal fortune f: Thus, if r = (ø, t) is a policy, it is 


Sec. 10] The utility of fortunes, policies, and houses 26 
appropriate to call 
(1) u(r) = uls, t) = ou(fi) 


the utility of r to the gambler. If u(f) is simply 1 or 0 according as f is 
or is not satisfactory, then the utility of r is simply the probability 
under o that f: is satisfactory—the probability under r that the gambler 
will succeed. 

With the policy r = (, é) is associated the family of couples 
a(f] = (Lf), iif). (The meaning of the components is as in Sections 5 
and 9.) Except where ¢[f] = 0, z[f] is itself a policy, the conditional 
policy gwen f, and it has a utility u(a[f]); where t[f] = 0, it is useful 
to let u(a[f]) be u(f). In these terms, 


(2) u(r) = f u(efl) doof); 


the utility of a policy is the expectation under its initial gamble 
of the utility of the part of the policy that remains after the first 
gamble, so to speak. 

The gambler’s object is to make u(r) as large as possible subject 
to his initial fortune f and the rules of the gambling house T or, if he 
finds that preferable, to settle for u(f). Therefore, let 


(3) U(f) = the maximum of sup u(r) and u(f), 


confining the supremum to those policies r that are available in T at f, 
and call the number U(f) the utility of T at f. To make explicit the 
dependence of U on T and u, it is sometimes better to write Tu for U. 

For the purposes of most of this book, the general ‘‘gambler’s 
problem” is to find U when T and u are given and to determine policies 
that are optimal or nearly optimal. Simple though the concept of U 
defined by (3) is, few passages in this chapter thus far have had any 
other objective than to contribute to the definition. In our experience, 
this formulation of the utility of T has been fruitful and satisfying. 
The next section shows that a slightly different approach leads to the 
same U. The next chapter enlarges the notion of gambler’s problem 
by introducing a function V never greater than U and typically equal 
to U, that seems to have a more fundamental claim to measuring the 
worth of T. 


26 Formulation of the abstract gambler’s problem [Chap. 2 


It is implicit in the extramathematical interpretations that have 
led to the definition of U that there is no rule restricting the gambler 
from terminating play at any stage and enjoying the utility of the 
fortune at which he then finds himself. A foundation for the study 
of problems with such rules is given in the next chapter, and some 
further suggestions are in Chapter 12. 

Relaxation of the rules or an increase in the utility function is 
never unwelcome to the gambler. 


THEOREM 1. If TCI” and u<w’ (that is, r() CI’(f) and 
u(f) < u'(f) for all f), then Tu < r'u’. 


The mapping of u into Tu is not only nondecreasing in u, as 
Theorem 1 implies; it is also strongly continuous in u, as the following 
asserts. 


THEOREM 2. If u, converges uniformly to u, then Tun» converges 
uniformly to ru. In fact, if ju — u'| < e, then [Tu — Tu’| < e. 


11. INCOMPLETE STOP RULES 


A rule that assigns a terminal fortune to almost all histories, 
though perhaps not absolutely all, claims some attention. This 
section shows that the gambler can gain no material advantage from 
incomplete stop rules that terminate for almost all histories. 

An incomplete stop rule is a function t defined on histories and tak- 
ing as values positive integers, and possibly œ, such that if t(h) < © 
and h’ agrees with h through the t(h)th coordinate then t(h) = t(h’). 


Example 1. Let A be a subset of F, and let t(h) be the first n, 
if any, for which f» € A; for all other h, t(h) = œ. 


Suppose ¢ is incomplete but the set of histories h for which ¢(h) 
< œ has Eudoxus probability 1 under a strategy o. Then plainly, 
no matter how u(f:) is extended to be a bounded function defined for 
all h, u(f:) is Eudoxus integrable under c, and ou(f,) has the same value 


for all such extensions; this value is designated by u(c, t) in harmony 
with (10.1). 
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THEOREM 1. If ¢ is an incomplete stop rule and T is a finitary 
(or even closed) subset of {h: t(h) < œ}, then there is a complete 
stop rule ¢’ that agrees with ¢ for all h e T. 


Proof: Let h be any history. If there is an h’ in T that agrees 
with A in their first t(h’) coordinates, let é’(h) = t(h’). If no such h’ 
exists, let ¢/(h) be the least n such that no history h’ that agrees with h 
in their first n coordinates is in T. That t is a stop rule is easily 
verified. 


THEOREM 2. If an incomplete stop rule ¢ is finite with o-proba- 
bility 1, then there is a complete stop rule t’ for which |ou(f:) — ou(fr)| 
is arbitrarily small. 


Proof: Theorem 1 applies. 


The decision to restrict attention to stop rules as originally 
defined therefore seems innocuous. In particular, the important 
function U is not affected by this decision. 

The incomplete stop rules, as functions from H to the positive 
integers and œ, have the natural partial ordering in which ¢ < t’ 
if and only if (h) < t’(h) for all h. 


THEOREM 3. Under the natural partial ordering, the stop rules 
form a sublattice of the lattice of incomplete stop rules. The maxi- 
mum of any finite set, as well as the minimum of any set, of stop 
rules (incomplete stop rules) is a stop rule (incomplete stop rule). 
The minimum of a stop rule and an incomplete stop rule is a stop rule. 


The concluding paragraph of Section 9 can be so extended for 
incomplete stop rules as to embrace Theorem 3, which is also easy to 
check directly. 


12. FUNCTIONS THAT MAJORIZE U 


This section revolves about a simple theorem which often applies 
to show that some function Q is at least as large as U. We are much 
indebted to Aryeh Dvoretzky for bringing home to us the truth and 
importance of the theorem. 
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If yQ < Q(f) for some fortune f, gamble y, and function Q on F, 
then, consonant with certain publications on Markov processes such 
as (Hunt 1957): Q is excessive for the gamble y at f. If Q is excessive 
for co at f and foro,(fi, © + © Ja) at fa forall n and (fi, © © © , fa), then 
Q is excessive for the strategy c, and for each policy (0, t), at f. If, for 
all f, Q is excessive at f for each y in T(f), then Q is excessive for the 
gambling house T. 

Plainly, Q is excessive for T if and only if, for all f, Q is excessive 
for every policy (strategy) available in T at f. Also, Q is excessive 
for a policy (strategy) at f if and only if that policy (strategy) is 
available at f in some house for which Q is excessive. 

Here is one more expression of the conservation-of-subfairness 
idea, whose importance in probability was mentioned in Section 1.3. 


LEMMA 1. _ If Q is excessive for r at some f’, then Q(x) < Q(f’). 


Proof: The following calculation is justified by (10.2), Theorem 
9.3, and an induction on the structure a(f;). 


(1) Qa) = | QL) dolf) 


< | Q) dolf) 
<Q). + 


THEOREM 1. If u <Q and Q is excessive for T, then U < Q. 
(That is, if u(f) < Q(f) and YQ < Q(f) for all f and all y in T(J), then 
U(f) < QC) for all f.) 


Proof: Since u(r) < Q(z) for all r, Lemma 1 implies that u(r) < 
Q(f) for all f and all r in T at f. Consequently, U < Q. ¢ 


This theorem has previously been used implicitly in gambling 
problems, in particular by Blackwell (1954) and by de Finetti (1939, 
1940), who traces the idea through (Bertrand 1907) to De Moivre. 
Other well-known problems whose solutions implicitly involved this 
theorem are described in Sections 12.4 through 12.9. Throughout 
this book, Theorem 1 will play an explicit and important role. 

Though Theorem 1 has been easy to prove directly, a slightly 
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longer and more general-looking path shows its relation to some 
current probability theory. Consider a strategy o, a constant Qo, 


and a uniformly bounded sequence of functions Qı, Qe, - - - defined 
on H and such that: 
(a) Qn depends only on the first n coordinates fı, - -© - „fa ofh. 
(b) The expectation under o of Qn41 given fi, © © © , fa is at most 
Qn: 


Such a sequence Q, ought, in the spirit of current usage (Doob 
1953), to be called a lower semimartingale for the increasing pattern 
of information fı, - - + , fz. The condition (b) is of course interpreted 
formally thus: 


(D f Query > > y Sas fasa) don(fay © > + p Sn) (fos) 
< Qn(fi, _ 3" , fa). 


The following theorem is a finitely additive version of a promi- 
nent theorem about semimartingales; compare (Doob 1953, The- 
orem VII2.2). 


THEOREM 2. If {Q,} is a lower semimartingale with respect to ø, 
and t is a stop rule, then oQ: < Qo. 


To paraphrase, the expected terminal cash fortune yielded by 
any stop rule applied to a succession of uniformly bounded fortunes 
resulting from subfair bets is at most the initial fortune. 

The proof of Theorem 2 is sufficiently suggested by that of 
Lemma 1. 

With Theorem 2, Lemma 1 can be re-proved thus. Let Qo = 
Qf), Qal fi, © © © > fn) = Qn), where Q is as in Lemma 1. Then 
{Qn} is plainly a lower semimartingale with respect to any o in I at f. 
Theorem 2 then applies to yield the conclusion of Lemma 1 again. 

(Theorem 2 can be viewed as a special case of Lemma 1 by means 
of a device that will be formalized in Section 12.2, namely, the device 
of regarding partial histories of a given space of fortunes F as the 
fortunes of a new space of fortunes.) 

If U(f) were to be defined with reference to sup u(r) over some 
restricted class of policies, for example by contracting T or by imposing 
measurability conditions, U(f) would not be increased thereby, and 
so Theorem 1 would remain true a fortiori. 
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Theorem 1 gives a useful sufficient condition for a function Q 
to majorize U, that is, to be at least as large as U everywhere. Still 
more, if for some f there is a r available in T at f for which u(r) equals 
or is arbitrarily close to Q(f), then clearly, for that f, Q(f) must actu- 
ally be U(f), as the following theorem underlines. 


THEOREM 3. If Q(f) < U(f) for some f, Q is excessive for T, and 
Q majorizes u, then Q(f) = U(f). Consequently, if the first hypothe- 
sis holds for all f, then Q is U. 


The remainder of this section sometimes applies to show that U 
is at least as large as some function Q. This variant of Theorem 1 can 
be skipped or postponed. 

A bounded function Q on F is deficient at f for a strategy o if: 
(a) ooQ > Q(f) and (b) for all n > 1 and all fi, © © © , fn, 


on(fi, © © © , fa) = Ra). 


THEOREM 4. Suppose that for some f there is a o available in T 
at f and a Q deficient at f for c, and that for every positive e there is a 
stop rule ¢ for which u(f;) > Q(f:) — e with o-probability at least 
l — e. Then U(f) > Q(f). 


Proof: U(f) > culfà > cQ(f:) — e — esup (Q — u) > Q(/) — e 
— e sup (Q — u), where the proof that cQ(f:) > Q(f) is simple and 
imitates that of Lemma 1. ¢ 


13. DIGRESSION ABOUT COUNTABLE 
ADDITIVITY 


Since noncountably additive gambles are often regarded as 
pathological, some readers may now be interested in conditions 
guaranteeing that the gambler’s ‘earning ability” is not affected if he 
is restricted to conventional gambles and strategies. Others may 
wish to omit this section, or to postpone it until the same theme is 
touched upon later. 

Theorem 12.3 can be useful in verifying that some new restriction 
on the gambler does not affect his earning ability. One application is 
this. It may well happen that in a first formulation of the problem 
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the gambles are defined only on some class (perhaps a Boolean algebra 
or sigma-field) of special interest. Perhaps, too, they are countably 
additive when first defined. There may well be hope that it is imma- 
terial how the definition of the gambles is extended beyond this algebra. 
For example, the y’s might originally be defined on the Borel sets 
of the real line, u might be Borel measurable, and, if the problem is 
happily formulated, there will be reason to hope that there is some 
policy arbitrarily nearly optimal among the policies that deserve to be 
called Borel measurable. 

A definition of measurability for policies suggests itself: With 
respect to a sigma-field of subsets of F called measurable, o is measur- 
able if o,A is measurable in its arguments fı, © * © , f, for every 
measurable set A of fortunes. And r = (øc,t) is measurable if o is 
measurable in the sense just defined and if ¢ is measurable in the 
ordinary sense for Cartesian products of measurable spaces. If u 
and r are measurable, the value of u(r) is determined by the values 
that the gambles take on measurable sets of fortunes, as may be seen 
by induction on the structure of t. 

Investigation will show (in Section 16) that, if Tr(f) and u(f) 
depend sufficiently smoothly on f, then measurable, nearly optimal 
strategies exist and U is measurable. Sometimes, even where T(f) 
does not depend smoothly on f and no useful measurable strategies 
exist, the values of the gambles y for nonmeasurable sets are nonethe- 
less immaterial and U is measurable. The values of y for nonmeasur- 
able sets may, however, become quite material for U when such a 


problem is modified by placing a bound on the time allowed for 
gambling. 


Example 1. Let F be the closed unit interval [0, 1] together with 
{2}, and let K, with indicator function k, be a subset of [0, 1] 
with inner (Lebesgue) measure O and outer measure 1. For f 
in K, let I'(f) consist of 6(f) and 6(2); for f not in K, let I'(f) 
consist of 6(f) and y, where y has these three compatible proper- 
ties: y{2} = 3; yA is half the Lebesgue measure of A if A is 
a measurable subset of [0,1]; yK = 4 — a for an arbitrary a 
in (0, 3]. Finally, suppose u(f) = 0 for f <1 and u(2) = 1. 
The supremum of u(r) over policies r that begin at f e [0, 1] and 
are such that t < n is easily seen to be (1 — ła!) + $a”—k(f). 
This depends on a, the probability under y of a nonmeasurable 
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set (and is not measurable in f). The fact that the constrained 
supremum approaches 1 in n and that u < 1 shows that U = 1. 
Consequently, U is independent of a and measurable in f. In 
this example, u(r) < % for any measurable r beginning at f in 
[0, 1] and not in K. 


Let Q(f) be the maximum of u(f) and the supremum of u(r), 
where r is restricted to, say, Borel-measurable policies in T at f, and 
suppose, for a moment, that Q is Borel measurable. Theorem 12.3 
implies that the manner of extending the y’s is immaterial if yQ < Q(f) 
for all f and y in I'(f)—a condition which is, of course, verifiable in 
terms of the unextended y’s alone. A later conclusion (Theorem 14.1) 
implies that this sufficient condition for Q to be U is also necessary. 
The principle is frequently illustrated in later chapters where a Q 
comes under consideration because it is approached by means of 
Borel-measurable (or even much more regular) policies that are sus- 
pected of being optimal or nearly so. Clearly, for such a Q, Q(f) < 
U(f). Verification that YQ < Q(f) and u(f) < Q(f) for all f and y 
in I'(f) then shows that Q is indeed U and that “regular” policies can 
be nearly optimal. If Q is not measurable—and this could easily 
happen for a sufficiently ill-formulated problem—then y should be 
replaced by its upper integral y* in this test. 


14. U IS EXCESSIVE FORT. 


The first hypothesis of Theorem 12.1 is obviously automatic for 
every majorant Q of U. The second, namely that Q be excessive for T, 
is not automatic. To see that it is not, add a large constant to any 
function Q that is not excessive for T. For U itself, however, even 
the second hypothesis is automatic: 


THEOREM 1. yU < U(f) for all f and all y in I'(f). 


Proof: Suppose that, for some f’ and yinI(f’), yU = U(f’) + 6, 
with 6>0. Let r(f) = @(f), t(f)) be, for each f at which u(f) < 
U(f), a policy in T at f for which u(x(f)) > U(f) — 46. Construct 
any new policy r’ that begins with y and terminates at time 1 if 
u(fi) = U(fi) and otherwise continues with z(f1). More formally, 
co = y; o'[f] is arbitrary if u(f) = U(f) and is o(f) otherwise; and 
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t'(fh) is 1 if u(f) = U(f) and is t(f)(h) + 1 otherwise. 


(1) U(f’) = ule’) 
= | uf) doo) 


= f uel) ar(f) 
> f(u - sen 


=U age 


As Theorem 1 says, U is excessive for T. In dynamic program- 
ming applications, this fact is called “the principle of optimality”. 
However, in a conventional countably additive theory, where U(f) is 
ordinarily the supremum of u(r) for measurable z in T at f, Theorem 1 
would pose the difficulty that an optimal or near optimal z(f) might 
not vary measurably with f, so the integral in (1) might not exist. In 
fact, the theorem is not true for the U associated with measurable 
policies; it obviously fails for Example 13.1. 


COROLLARY 1. U is the smallest of all functions that are exces- 
sive for T and majorize u. Consequently, Q = U if and only if 
u < Q < U and Q is excessive for T. 


Of course, this corollary which characterizes U subsumes Theo- 
rem 1 and Theorems 12.1 and 12.3. 


COROLLARY 2. If u<v< U, then Iv = U. In particular, 
rU = U. 


If, for all f, y eT(f) if and only if y e T'(f) or y eT” (J), then 
T is the union of T’ and T”. Of course, U is then at least as large 
as the maximum of U’ and U”. 


THEOREM 2. Let TI be the union of I’ and T”. Then U’ is exces- 
sive for T” if and only if U = U’. In this event, U’ > U”. 
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15. LIMITED PLAYING TIME 


It is interesting to consider what the gambler can achieve if 
some limitation is put on the duration of play. It is assumed through- 
out this section that, for each f, the one-point measure 6(f) is in I'(f). 
The assumption could be dropped at the cost of minor complications, 
but the gain in generality would be only superficial. 

Let Uo = u; for each positive integer m let Um = sup u(r) over 
policies r = (c, t) available in T at f, with t < m; let U, = sup Un. 

(A variant of this notation advantageous when indices larger 
than w are to be used is this: Ui = u, Ua = sup u(r) over r in T at f, 
with the structure of fe < a. Fora = m, an integer, Um = Uj4:, and 
U., = UZ; so the two systems are essentially equivalent for a < w. 
However, the definition of U, is ad hoc in the first system; extending 
the definition of Um to general ordinal indices would lead to U. = 
Ui41, and so U, would be left out, as would U4 for every other limiting 
ordinal a.) 


THEOREM 1. If m< m, then u = Uo < Un < Um < Ua < U; 
and liMm Um = U4. 


THEOREM 2. For y ranging in r(f), Um+1(J) = sup yUn. 


In the concrete problems of later chapters, it is almost always 
true that U, = U, but here is an example in which the equality fails. 


Example 1. Let: F beall pairs f = (i, 7) of nonnegative integers; 
y be diffuse on the fortunes (0, 7); Tr(0, 0) = {6(0, 0), y} and, for 
other f, T(f) = {6(f), èli + 1,7)}; u = 0 or 1 according asi <j 
ort >j. It is evident that U = 1, but that Um(0, 0) = U.(0, 0) 
= 0 for every m. 


Just as in ordinary countably additive probability theory, if 
V, V1, V2, © > | are real-valued functions of fortunes and y is a gamble 
such that, for every positive e, y{ f: |v(f) — on(f)| > e} converges to 0 
as n approaches œ, then v, converges tov in y-probability. The follow- 
ing is a finitely additive expression of the Lebesgue convergence 
theorems. (For another version, see (Dunford and Schwartz 1958, 
Theorem 7, p. 124).) 
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THEOREM 3. If uniformly bounded vı, v2, - © - converge to v in 
y-probability, then lim yu, = yv. If the v, are monotonic in n, then 
the converse is true, too. 


THEOREM 4. If, for all f and y in I'(f), Um converges in y-proba- 
bility to U., then U,, = U. 


Proof: According to the basic Theorem 12.1, the following calcu- 
lation, based on Theorems 2 and 3, provides the proof. For every f 
and y in I(f), 


(1) vyU., = lim YUm < lim Uniil(f) = U(f). + 


m- V 


THEOREM 5. JU, = U in each of the following seven cases: 

(a) For every available y there is a set of arbitrarily small 
y-probability outside of which Um converges uniformly to U». 

(b) Um converges uniformly to U.. 

(c) F is a compact topological space on which U„ and Um are 
continuous. 

(d) F is a topological space on which U,„ and Um are continuous, 
and, for each y, y of the complement of sufficiently large compact 
sets is arbitrarily small. 

(e) F is a compact interval of real numbers, U., is continuous, and 
each Um is monotonic. 

(f) F is a not necessarily compact interval of real numbers, 
U., is continuous, each Um is monotonic, and, for each y, y of the 
complement of sufficiently large compact subintervals of F is arbitrarily 
small. 

(g) F has a sigma-field on which each y is countably additive 
and with respect to which each Um is measurable. 


16. CONTINUOUS GAMBLING HOUSES 


The purpose of this section is to illustrate that regularity condi- 
tions on a gambler’s problem imply regularity conclusions about its 
solution. The hypotheses to be assumed in this section apply with 
trivial modifications to all the specific gambler’s problems in this book, 
except to examples designed to exhibit irregularity. Later chapters 
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will make no use of this section which is, in a sense, a continuation of 
Section 13. It can, therefore, freely be postponed or omitted. 

Throughout this section: 

(a) F is a compact metric space. 

(b) The notion of a gamble y is identified with its restriction to 
the Borel subsets ® of F and also with the equivalence class of all 
gambles that agree with y on 8. 

(c) Every available y is an element of A, the countably additive 
probabilities on @. 

(d) For each f, T(f) is closed in the weak topology on A induced 
by the continuous functions on F, and I'(f) contains 6(f). 

(e) The mapping f — T(f) is continuous for the Hausdorff-metric 
topology on 24, the nonvacuous, closed subsets of A, as in (Hausdorff 
1957, Section 28). (The conclusions and proofs of this section remain 
valid under the weaker assumption that the mapping f— T(f) is 
upper semicontinuous in the sense of Kuratowski (1932). Namely, if 
fn approaches f, yn ET (fn), and yn approaches y, then y € [(f).) 

(f) u is upper semicontinuous on F; that is, {f: z < u(f)} is a 
closed subset of F for each real number z. 


THEOREM 1. For every nonnegative integer m, Um is upper semi- 
continuous and therefore Borel measurable; also U = U, and is Borel 
measurable. There is a sequence Yo, Yı, © © © of gamble-valued func- 
tions defined on F such that: 7; is Borel measurable with respect to 
the Borel subsets of A; 7;(f) e T(f) for all f and 7; u(r) = Um+:ı(f) if 
m is a policy for which t = m + 1 and the first m + 1 gambles of 
o are 


oo = Yn(f); 
o1(fi) Yn—1(F i), 


(1) 
Om(fi, © © * , fm) = Yo(fm). 
Therefore Borel-measurable nearly optimal strategies exist. 


The proof of the theorem will depend on seven lemmas. 


LEMMA 1. If u is upper semicontinuous on F, then yu depends 
upper semicontinuously on the gamble y. 
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Proof: Easy in consequence of the fact (Hausdorff 1957, Section 42) 
that u is the limit of a descending sequence of continuous functions. ¢@ 


(Lemmas 2 through 5 and Lemma 7, in effect, apply to arbitrary 
compact-metric spaces F and A, and Lemma 6 applies to an arbitrary 
measurable space F and compact metric space A.) 

Lemmas 2 through 7 refer to an upper-semicontinuous real- 
valued function v on A. Associated with v are: a real-valued function 
v* with domain 24, 

(2) v*(K) = max v(y); 
yEK 
and a mapping V of 24 into itself, 
(3) V(K) = {y: y eK and v(y) = v*(K)}; 


and a mapping V of the Cartesian product of 24 and the real numbers, 


(4) V(K, 2) = {v: y eK and o(y) > z}, 
which, except when vacuous, is in 24. 


LEMMA 2. v* is upper semicontinuous and is therefore Borel 
measurable. 


LEMMA 3. V is upper semicontinuous (on the closed set where 
its value is nonvacuous) in the sense of Kuratowski (1932) and is 
therefore Borel measurable. 


LEMMA 4. FV is Borel measurable. 
Proof: V(K) = V(K,v*(K)). + 


(We thank Donald Ornstein for a proof of Lemma 4 and Gerard 
Debreu for warning us away from a false short cut.) 


LEMMA 5. The mapping f— V(I(f)) is Borel measurable. 
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LEMMA 6. There is a Borel-measurable mapping 7 of F into A such 
that 7(f) eT (f) and o(7(f)) = o*(T(f)). 


Proof: Let w; be a sequence of continuous, real-valued functions 
on A such that, if y = vy’, there exists an 7 with w:(y) = w.(7’). Define 
W; in analogy with V, and let To(f) = V(T(S), Pnai(f) = Wnii(Tn(f)). 
Each sequence of compact sets T,(f) decreases to a one-point set 
{v(f)}. Since 7¥(f) eVT(A)), v) = v*(T(f)). Since {7(f)} = 


lim T,,(f), {y} is a measurable mapping, and hence soisy. @ 


(Lemma 5 and, which is more important, Lemma 6 depend only on 
the measurability, not on the semicontinuity, of T(f) in f. This 
semicontinuity is, however, essential to the next and final lemma). 


LEMMA 7. v*(T(f)) is upper semicontinuous in f. 


Proof: v*isnotonly uppersemicontinuous but nondecreasing. @ 


Proof of Theorem 1: U. = u, which is upper semicontinuous by 
assumption. Ifv is the mapping y —> yUm, then Umii(f) = UX(T(f)). 
Therefore each Um is upper semicontinuous, in view of Lemmas 1 
and 7. 

Each m is obtained by applying Lemma 6. 

According to part (g) of Theorem 15.5, Us = U. Measurable, 
nearly optimal strategies are obtained by continuing (1) for large m 
with omir(fi, © © © > fmtr) = lfm). © 


If v is continuous, so is v*. Therefore if u is continuous, so is Um 
for each m. Are there then continuous nearly optimal strategies? 

The hypothesis that 6(f) e I'(f) is almost superfluous, but, as the 
next chapter will make clear, if this hypothesis fails, Theorem 1 lacks 
interest and some deeper theorem should replace it. 

It would be good to know to what extent the compactness of each 
T(f) is essential to Theorem 1 and whether there are measurable 
nearly optimal strategies if T and u are assumed only to vary measur- 
ably with f. 


3 
STRATEGIES 


1. INTRODUCTION. This chapter, like the preceding one, is 
sufficiently general and abstract to apply to gambling problems 
based on any set of fortunes. Here the study of strategies, 
which in Chapter 2 played a role subsidiary to that of policies, 
is pursued. This chapter is entirely independent of Chapter 4, 
which might well be read first, and though this chapter is logically 
preliminary to much beyond Chapter 4, it is not quite so basic 
as most of Chapter 2. 


2. THE UTILITY OF A STRATEGY 


Strategies are closely akin to policies. The main reason for 
considering both is that, while policies are simpler to work with, 
strategies are conceptually simpler and optimal policies rarely 
exist. 

If the kinship is to be close, a strategy, like a policy, must 
be assigned a utility. We do not intend to appraise a strategy o 
in terms of the utilities of fortunes visited early, nor would it be 
appropriate to penalize o for visits to fortunes of low utility 
however frequent, if these serve as stepping stones to fortunes 
of high utility. These considerations, together with the remark, 
in Section 2.11, that stop rules, as functions from H to the integers, 
are naturally partially ordered, suggest this definition: 


(1) u(c) = lim sup u(o, t). 


39 
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The “lim sup” here means, of course, the supremum of those num- 
bers c such that for every t there is a t’ with t’(h) > t(h) for all h and 
ule, U) > c. 


The definition (1) would be unsatisfactory if it did not permit 
this theorem: 


THEOREM 1. For allo, 
(2) ulo) = f ulelf]) doo(f). 
Proof: Equation (2.10.2) says that 


(3) ule, t) = f ulelfl, Uf) doo(f). 


For a given stop rule ¢ and positive e, and for all f, let t’(f) be a 


stop rule such that t'(f) > t[f] and u(olf], t (f)) > ule[f]) — «. There 
is a stop rule ¢’ defined by the condition ¢t’(fh) = t'(f)(h) + 1; equiv- 
alently, [f] = t'(f) for all f. Clearly, t’ > t, and, according to (3), 


(4) ule, t) = | ulclfl, t Lf) doo(f) 
= | ul, (f) dof) 


> | uGlf)) doo(f) — e. 


Therefore, u(c) > f u(o[f]) doo(f). 

On the other hand, for each e and f there is a stop rule é(f) such 
that u(o[f], ’(f)) < ule[f]) + e for t’(f) as large as t(f). If t is the 
stop rule for which é(fh) = t(f)(h) + 1 for all h, then t[f] = t(f), and, 
for t > t, U[f] > (f) forall f. Ift >t, 


(5) ulo, t) = f ull], UL) doo(f) 


< f ulolf) dolf) +e. o 
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3. STRATEGIC UTILITY 


The notion of a gambler’s ceasing to gamble after the partial 
history p = (fı, © © © , fa) can be given two technical interpretations. 
First, it can mean that he is employing a policy which terminates 
at time n after that partial history. Second, it can mean that the 
continuation of his strategy after p is such that, with probability 1, 
the fortune remains f, time after time. As this section and the next 
will show, these two senses of ceasing are so close to each other in 
their effects that each policy can be imitated by a strategy. More- 
over, as the next section makes evident, provided ô(f) € r(f) for all f, 
a strategy o that imitates r is available in T at f if r is. 

A gambling house T is leavable if ô(f) Ee I(f) for all f. We had 
so little spontaneous interest in nonleavable gambling houses that 
we were tempted to make leavability part of the official definition 
of a gambling house. We find, however, that the more general concept 
leads to better insight into the special one of main interest and, as 
Chapter 12 indicates, some problems of current interest are most 
naturally handled in the theory of not necessarily leavable houses. 

In this chapter, and in some later contexts where the distinction 
makes a difference, we shall consider not only the utility U of a 
gambling house T but also the strategic utility V, where V(f) = sup u(c) 
over all o available in T at f. Comparison with the definition of U by 
(2.10.3) and with the definition of the utility of a strategy in Section 2 
shows immediately that U majorizes V. Pictorially speaking, U 
reflects the possible achievements of a gambler who is free to go home 
when he pleases, whereas V represents the achievements of a gambler 
who is subject to detention in the gambling house for an arbitrarily 
long time and who must even select his o before he is informed of 
the length of his detention. If the gambling house is leavable, then 
V and U are the same, as Corollary 2 states. When the gambling 
house is obviously leavable, we ordinarily write U rather than V. 
The notion of ‘‘gambler’s problem” introduced in Section 2.10 is 
now modified to mean the determination of V and of optimal or 
nearly optimal strategies. 

With the aid of Theorem 2.1, it is as easy to prove that V is 
excessive for T as it was to prove the corresponding fact (Theorem 
2.14.1) for U. Similarly, if Q is excessive for T and Q(c) > u(c) for 
all e available in T, then it is easy to paraphrase the proof of Theorem 
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2.12.1 to conclude that Q majorizes V. These remarks and one lemma 
easily pave the way to extensions to V of the basic facts about U as a 
function excessive for T. 

For each nonvacuous partial history p = (fi, ©- © ,fn), let 


Ip) = fn. 


LEMMA 1. For all f and all c available in T at f, V(c) > u(o). 


Proof: The two general formulas, 


(1) ule) = | ulolp]) an(w)(p) 
and 
(2) f VAW) dap) = f VO) dye) () = Ve), 


are applicable to any bounded functions u and V of fortunes, as is 
easily verifiable by induction. (Compare with the related formula 
(2.9.6) and Theorem 2.1.) In the special case that V is the V of aT, 
and o is in T at some f, V(l(p)) > u(o[p]) for all p. Consequently, 
VG, t) = V(r) > u(e) for all t; so Vio) > ule). + 


THEOREM 1. FV is the smallest of all those functions Q that are 
excessive for T and for which Q(c) > u(c) for every o available in T 
(at any f). 

COROLLARY 1. If V > wu, then V is U. 

COROLLARY 2. IfT is leavable, V is U. 


Let TŁ, the leavable closure of T, be the smallest leavable T that 
includes T. That is, P(f) = I'(f) U {6(f)} for every fortune f. 


COROLLARY 3. The U of any gambling house T is the V of I'¥. 
As Theorem 1 and its corollaries suggest, it would have been 


mathematically more efficient to begin with the concept V and regard 
that of U as auxiliary. We thought it better, however, to present U 
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first—in imitation of our own experience—because, in the problems 
that interest us most, T is leavable. 


COROLLARY 4. Ifo is a strategy available in T at f, and ¢ and f¢’ 
are stop rules with ¢ < t’, then 


(1) Vf) 2 oV > VG, t) = V, t) > Ve) > uc). 


4. STAGNANT STRATEGIES 


This section shows that, for every fortune f’, there is a strategy 
o’ that imitates the act of accepting the initial fortune f’ without 
actually embarking on a policy and, for every policy r, there is some 
strategy o that imitates r. For every u, u(c’) = u(f’) andu(c) = u(r). 
The strategy o’ is available in every leavable T at f’, and, for every 
leavable T and fortune f, o is available in T at f if r is. These facts 
go beyond the assertion of Corollary 3.2 that U is V for every leav- 
able T. 

If, for some h and ø, every finitary set has probability 1 or 0 accord- 
ing as h is or is not in the set, o (or, more accurately, the measure deter- 
mined by e) is the one-point measure (h) ath. If F has more than one 
element, no one-point set of histories is finitary according to Corollary 
2.7.1. Yet the finitary sets (and even those of finite structure) are 
adequate to separate points. Therefore, if 6(h) = 6(h’), then h = Nh’. 
(Of course, different strategies ¢ can determine the same measure v, 
which can, in particular, be a one-point measure.) 


THEOREM 1. The following conditions are equivalent: 

(a) o = lh). 

(b) og = g(h) for all inductively integrable g. 

(c) og = g(h) for all inductively integrable g that depend on only 
finitely many coordinates, that is, are of finite structure. 

(d) oo = O(f1) and op(fi, © © © , fn) = O(fn4i) for all positive n 
(where h= (fi, fe, a J): 

(e) For each n, the probability under o that the nth fortune is 
fais 1. 

(f) For each stop rule t, the probability under ø that t = t(h) is 1. 

(g) For each t, the c-probability that fe = few is 1. 

(h) oo = ô(fı) and o[f.] = ô(h’), where h’ = (fo, fa, © © °). 
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Of course, the components of the strategy o along histories other 
than h have no bearing on whether the measure ø is 6(h). 

Let h; be the history (f, f,f, - - -). If the measure ø is ô(h;), 
the strategy o stagnates immediately at f. For o to stagnate immedi- 
ately at f it is necessary and sufficient that u(c, t) = u(f) for all t and u. 
If the conditional strategy o[f:, - - > , fa] (defined in Section 2.5) is 
d(h;,), that is, if offi, © © ©- ,f,] stagnates immediately at fa, the 
strategy o stagnates (at n) at (fı, © © © , fn). The gambler here decides 
after (fı, © > > , fn) to remain at fn with probability 1 on his (n + 1)st 
gamble, to do so again at his (n + 2)nd if he finds himself at f, (which 
he is almost certain to), and so on. 

Stagnation is closely akin to termination. In particular, if stag- 
nation occurs at a given partial history (fı, © - - , fa) and if the stop 
rule ¢ stops then or later, the terminal fortune given the first n coordi- 
nates (fı, © ©- © ,fn) is fa with probability 1, as the next theorem 
formally asserts. 


THEOREM 2. Ifostagnatesat (fi, © © © fa) and if tfifz © ° -fa Èn, 
then 


(1) olfi, o faih: fifi + + hah) = fa} = 1. 


Proof: The measure concerned is the one-point measure on the 
history h = (fn, fa, © © *), and the set concerned contains this A, 


since fifi © © © falh) =fra 


With each o associate the (possibly) incomplete stop rule te such 
that t.(h) is the first n, if any, for which o stagnates at (fi, © © © , fr); 
failing such an n, te(h) = ©. We intend that é.(h) = 1 if o stagnates 
immediately or at time 1 at fı. According to the definition of te, tet) = 
tf — 1, unless o[f] stagnates immediately at f, in which case toy) = 
tf = 1. 

As the following theorem says formally, it is immaterial when a 
gambler leaves the gambling house once he has decided to remain 
inactive. 


THEOREM 3. For any utility u and policy (ø, t), 


uls, t) = uls, min (ta, t)). 
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Proof: Recall the convention that u(c[f],0) = u(f) implied in 
the paragraph containing (2.10.2), so that (2.3) is valid without excep- 
tion. Then proceed by induction on the structure a(f,), calculating 
thus. 


(2) ule, t) = f ulolfl, tf) doP) 
2 J u(o[f], min (tayi, eLf])) doo(f) 
= f u(clfl, min (tf — 1, f — 1) doo(f) 
= f u(clfl, min (tef, f) — 1) dolf) 
= f u(offl, min (te, Df — 1) doo(f) 
= | ulelf], (min (te, DISI) doof) 
= u(c, min (ta, À). + 

If t, is a (complete) stop rule, o is stagnant. 


COROLLARY 1. If there is a stop rule ¢ for which ¢ > te, then ø is 
stagnant and u(c, t) = uls, te). 


COROLLARY 2. Ifo is stagnant, then u(c) = w(a, te). 


Just as it is immaterial to u(r) where termination occurs, pro- 
vided it is not before stagnation, so, too, the behavior of the strategy 
after termination is immaterial. 


THEOREM 4. If oo =o and if, for all h = (fi, fz, ©- :) and all 
n < tlh), on(fi, © © +> fn) = nlf © > , fa), then uo’, i) = ulo, t) 
for all u. 


For each history h = (fı, fe, - - :) and stop rule t, if t(h) >n, 
t terminates after p = (fi, © © © , fn); Wf t(h) < n, t terminates by p. 

For each policy r = (ø, t), there is a strategy o’ closely equivalent 
tovr in its effects. The natural candidate for o’ iso, defined by o,(p) = 
o(p) or 5(l(p)) according as ¢ terminates after p or by p. (Recall that 
l(p) is the last coordinate of p.) 
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THEOREM 5. For all r, c, is a stagnant strategy with ti) < t; 
gy is available in any leavable gambling house T at f for which øe is; 
and ulsz, t) = u(r) = ua, t) = ulsz). 


If the set of histories where ¢, is finite has (Eudoxian) probability 1 
under ø, then o stagnates almost certainly; u(c, te) is then defined in 
accordance with Section 2.11. 


THEOREM 6. Ifo stagnates almost certainly, u(c) = u(c, te). In 
fact, lim, u(c, t) = wl, te). 


Proof: Ift>t, ona finitary set A with complement A and cÅ < 
c, let t? = min (t, te). 


(3) lu(o, t) — uls, te)| = fuls, t’) — ue, te)| 
= |olu(fr) — ulft,)]| 
< (cA)[sup u — inf u]. 


The right side of (3) is arbitrarily small for all sufficiently large t. œ 


THEOREM 7. If u assumes only 0 and 1 as values, and if o stagnates 


at (fi, © © © ,fn) whenever u(fa) = 1, then w(c, t) is nondecreasing 
in ¢; consequently, ule) = lim; u(c, t). 


5. OPTIMAL STRATEGIES 


This section and the following three form a sort of subchapter 
about optimal strategies. This section introduces and makes a pre- 
liminary study of optimal strategies. Optimality is shown to be the 
intersection of two other properties. The next two sections study 
the two properties separately. A fourth section brings together some 
of the conclusions about optimal strategies implicit in the first three. 

From the point of view that led to the definition of U in Section 
2.10, a good behavior on the part of a gambler with initial fortune f 
is to adopt a policy r for which u(r) is very close to U(f) or to settle 
for u(f), if that is very close to U(f). If, however, all behavior is to be 
expressed in terms of strategies, which the preceding sections indicate 
can be done without mathematical loss, then good behavior at f is any 
strategy o available in T at f for which u(c) is very close to V(f). 
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So far as optimal, as opposed to merely good, behavior is con- 
cerned, we here focus attention on optimal strategies only. Optimal 
policies are rare and have not proved very interesting. In studying 
optimal strategies, we emphasize the general theory of not necessarily 
leavable gambling houses, so that V is not necessarily the same as U. 
At the same time, examples and counterexamples will be chosen from 
among leavable gambling houses. 

A strategy o available in T at f is optimal at f if u(c) = V(f). 
Though this does seem the almost inevitable definition of “optimal”, 
an optimal strategy is not necessarily quite without blemish. Even 
in the presence of countable additivity, an optimal strategy might 
permit bad behavior with probability 0; in the absence of countable 
additivity, bad behavior may occur along every partial history. 


Example 1. Let F consist of the positive integers 7. Let each 
I'(z) be the same for all 7 and consist of every gamble on F. Let 
u(i) =1—7-1. A strategy o that begins with a diffuse gamble y 
and then stagnates is available at every fortune 7 and is optimal 
there. Yet o[j], the conditional continuation of o after the initial 
gamble y results in 7, is not optimal. 


A strategy o that is optimal at f might be called thoroughly 
optimal at f if, for each partial history p, the conditional strategy 
o[p] is optimal at l(p). Some concepts intermediate between optimal 
and thoroughly optimal are suggested by the expression ‘‘almost 
thoroughly optimal”, but we refrain from exploration of any concepts 
stronger than that of optimality. The strategy o in Example 1 is of 
course optimal but not thoroughly optimal, though the gambling house 
T of that example abounds in thoroughly optimal strategies. 

The following reformulation of optimality is obvious in the light 
of Corollary 3.4. 


THEOREM 1. Aco available in T at f is optimal there if and only 
if V(f) = V(c) and V(c) = u(o). 


Theorem 1 displays the strategies optimal for u in T at f among 
those available in T at f as just those that have two properties that 
can be viewed as aspects of optimality. The next section investigates 
the strategies which have one of these properties, and the one after 
that, those which have the other. 

The next theorem is immediate from Theorem 3.1. 


48 Strategies [Chap. 3 


THEOREM 2. Ifu <w < V, then V’ = V, and a strategy optimal 
for u in T at f is also optimal for wu’ in T at f. 


A strategy can, of course, be optimal for u’ without being optimal 
for u. 


6. THRIFTY STRATEGIES 


The purpose of this section is to continue the exploration of 
optimal strategies by studying those strategies o that are thrifty for 
the V of a gambling house at some fortune f, that is, those for which 
V(f) = V@). 

It is convenient, however, to replace this by a superficially more 
general problem: Among the strategies o for which an arbitrary 
bounded function V is excessive, which ø are thrifty for V atf? There- 
fore, whenever ac, V, and f are mentioned in the rest of this section, 
it is to be understood that V is excessive for o at f, and it is also to be 
remembered that the conclusions have an immediate application to the 
situation in which V is the V of a gambling house T and ø is available 
in T at f. Examples and counterexamples will be so constructed 
that the strategy o will be available in a leavable gambling house T the 
U of which is V. 

All but the final inequality in Corollary 3.4 depend only on the 
fact that V is excessive for T at f. Therefore, for t < t’, 


(1) V(f) 2 oV > VG, t) > VG, t) > Vo). 
A reformulation of thriftiness flows immediately from (1). 


LEMMA 1. V(c) = V(f) if and only if V(e, = V(f) for all stop 


rules ż. 


If yV > V(f), y conserves V at f; ifoo conserves V at f and 
a;(fi, © © © , fi) conserves V at f; for 1 <j < n, o conserves V at f along 
h = (fı, fe, © - °) up to n. For each stop rule t, the event that o 
conserves V at f up to ¢ is finitary. If, for every t, this event has 
o-probability 1, then o persistently conserves V at f. 


LEMMA 2. Ifthe probability that o conserves V at fup totis 1 — e, 
then V(c, t) > V(f) — «(sup V — inf V). 
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Proof: Consider ¢ as a function of o and f and use induction on 
the structure of fae + 


(We thank Manish Bhattacharjee for Lemma 2.) 


THEOREM 1. Ifo persistently conserves V at f, then V(c) = V(f); 
that is, ø is thrifty for V at f. 


Proof: Apply Lemmas 1 and 2. ¢ 


(If o persistently conserves V at f, then the set of histories along 
which ø conserves V up to œ, that is, up to every n, has outer proba- 
bility 1. But its inner probability may be 0 even if F is finite; even 
more, it may include no nonempty finitary subset. 


Example 1. Let F = {0,1,2}; r(0) = {6(0)}, r(1) = 

{6(0), 6(1), 6(2)}, T(2) = {6(2)}; uO) = u(1) = 0, u(2) = 1; 
0o = 6(2), on(fi, poe Ja) = ô( fn) if Sn = 0 or 2, and 5(0) 
if fa = 1.) 


A converse to Theorem 1 for countably additive situations is 
indicated below, but the full converse is in conflict with the next 
example. 


Example 2. Let F consist of the ordered pairs of integers f = 
(i,j), with = 1 and 2 andj > 1. Let (1, 1) consist of 6(1, 1) 
and a diffuse y on the fortunes (1, 7) (that is, for all k, 


vif: i = 1 andj > k} = 1); 


for all other f whose first coordinate is 1, let r(f) consist of 6(f) 
and ô(g) for all g whose first coordinate is 2; for all f whose first 
coordinate is 2, let I'(f) contain only ô(f). Let u(i, j) = 0 or 
1 — j-! according asi = lor2. Then U(i,7) = 1 fori = 1, and 
1 — j~ for i = 2; y is the only nontrivial gamble that conserves 
U. Any c inT that first uses y and then, when the first coordinate 
is 1, uses any nontrivial gamble that does not decrease the second 
coordinate is optimal at (1, 1) and therefore thrifty at (1, 1), but 
ø does not persistently conserve U. 
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Though o need not persistently conserve in order to be thrifty, 
it must approximately do so. A gamble y e-conserves V at f if yV 
> V(f) — «e; if co e-conserves V at fando;(fi, © © - , fj) conserves V 
at f; for 1 <j <n, then o e-conserves V at f along h = (fi, fe, > >) 
upton. If, for each stop rule t, e e-conserves V at f up to t with o-prob- 
ability 1, then o persistently e-conserves V at f. 


LEMMA 3. If a is the o-probability that e econserves V at f up 
to t, then 


(2) Ve, t) < V(f) — (1 — ae. 


Proof: Use induction on the structure of f, thus. If sọ does not 
e-conserve V at f, then V(c, t) < ooV according to (1), andeo < V(f) 
— e. If co is e-conserving, use formula (2.10.2), Theorem 2.9.3, and 
the inductive hypothesis. 


THEOREM 2. If co is thrifty for V at f, then, for each positive «, 
ø is persistently e-conserving. (Of course, the assertion cannot be 
made for e = 0.) 


Proof: Apply Lemmas 1 and 3. ¢ 


COROLLARY 1. Ifo is thrifty for V at f and the partial history 
(fı, °° * ,fn) occurs with positive probability, then the gamble 
on(fi, © © © , fn) conserves V at fn. 


Theorem 1 states a sufficient condition that o be thrifty, which 
was seen in Example 2 not to be necessary. Theorem 2 states a 
necessary condition, which, as the next example shows, is not sufficient. 
We have not succeeded in closing this gap in the theory of thriftiness 
and optimal strategies. 


Example 3. Let F be the set of ordered pairs of positive integers 
f = (i,j), with i > j. Define a y(f) for each f thus: y(1, 1) is any 
diffuse gamble on the fortunes (i, 1); y(i, J) = ôli, j + I if7 < îi; 
y(i, i) = (7,7) if i>1. Let T(J) = {6(f), v(f)} and u(f) = 
—j/t. It is easy to verify that U(1, 1) = 0 and U(f) = u(f) if 
f # (1,1). Define a stagnant o available in T at (1,1) thus: 
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oo = y(1, 1), on(fi, © © © fa) = Y(fa). Define t(h) as the first 
coordinate of f;. Though o is persistently e-conserving, U (e) < 
U(r) = —1 < U(1, 1) = 0. 


In the presence of countable additivity, o persistently e-conserves 
V at f for every positive ¢ if and only if it does so fore = 0. In this 
important environment, then, Theorem 1 and Theorem 2 establish a 
condition necessary and sufficient for thriftiness. In order to avoid a 
technical discussion of measurability, the presentation of this fact 
is here limited to a special case, which is more than adequate for the 
applications in Chapters 5 and 6. 

As usual, a gamble y is discrete if there is a countable sequence of 
fortunes fı, fo, > © © for which È y{f:} = 1. A strategy o is (per- 
sistently) discrete if, for every stop rule t, with o-probability 1, the only 
gambles o(p) used prior to termination are discrete. 


THEOREM 3. If o is discrete, then V(c) = V(f) (that is, o is 
thrifty for V at f) if and only if sọ conserves V at f and o(p) conserves V 
at l(p) for every nonvacuous partial history p that occurs with positive 
o-probability. 


7. EQUALIZING STRATEGIES 


This section continues the study of optimal strategies for a 
gambling house T and in Theorem 2 characterizes those o that equalize 


u and V, that is, those for which u(c) = V(c). 
Consonant with Section 2.6, for each function g on H and each 


p = (fi, °° © , fn), gp evaluated at h’ = (fi, fo, ©- -is 


g(fi, ad , fas fi fo aii *). 


If g is inductively integrable, B is a subset of partial histories, and 
A = {h: ph) e B}, then 


(1) Jigdo = f, oip hgp) dolh) 
= fa olp\(gp) en(p), 


where n is the distribution of p, under ø, as is verifiable by induction 
on the structure of p;. 
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LEMMA 1. If w is the indicator function of a set of fortunes and 
c is any strategy (in T or not) for which w(c) > 0, then, for every 
ô > 0, there is a partial history p for which w(o[p]) > 1 — ô. 


Proof: For any positive «e and e’, and any stop rule t”, there is a 
t’ > t” for which 


(2) oth: w(olp(h)]) = e} < we) + e, 
as the next two paragraphs show. 

Choose ť > t” such that w(c) + ġe > wie, t) > we) — Fee’. 
Let A = {h: w(fe(h)) = 0 and w(o[p,-(h)]) > €’}, and let A be its 
complement. 


If ¢’ does not satisfy (2), then of{h: w(o[p;:(h)]) > e} > wle) + 
e > wle, t) + ge =of{h: w(felh)) = 0} + Se; so cA > Se. Clearly, 


wla, t) = fa feh) do(h). 


For each p, let t*(p) be a stop rule for which w(o[p], t*(p)) > #w(o[p]). 
Let ¢** be the composition of é’ with the family ¢* as in (2.9.2). Ac- 
cording to (1), 


fa oe) do = f, ipeo) dolh) 
= |, Wolpe], t*(pe(h))) do(h) 


If h is in A, let t(h) = t**(h); if h is not in A, let t(h) = t’(h). This 
defines a stop rule ¢, and 


w(c, i) = I, wf.) do -+ h w(f,) do 


= f, w( fi) do + wlos, t’) 
> gee + we) — tee 


> ws), 


which is impossible. Therefore ¢’ does satisfy (2). 
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For any stop rule ?’, 
(8) w(o) = f w(olpe(h))) dolh), 


in view of (3.1). 

In consequence of (2) and (3), were w(e[p]) bounded by 1 — ô, 
w(c) would not exceed e'(1 — w(c) — e) + (1 — ô) (w(e) + e) < wc) 
for e’ and e sufficiently close to 0. ¢ 


(Incidentally, Lemma 1 can, with some effort, be strengthened into 
a general (that is, finitely additive) version of Lévy’s (1937, Séction 41) 
martingale theorem, and even Doob’s (1953, Theorem VII 4.1) martin- 
gale convergence theorem can be so generalized.) 

For each «e > 0, a fortune f is e-unstable if u(f) > V(f) +. 
Under any available strategy, the gambler’s fortune is unlikely to be 
e-unstable far in the future. 


THEOREM 1. Let w. be the indicator of the «unstable fortunes. 
If o is available in T, then w.(¢) = 0 for each positive e. 


Proof: Otherwise, according to Lemma 1, for each ô > 0 there is 
a strategy o’, available in T, for which w.(c’) > 1 — 6. So, for each 
stop rule ż, there is a stop rule ť > t such that, with o’-probability 
at least 1 — ô, u(fe) > V( fir) +e. Consequently, ulo’, t) > Vi’, t’) 
+e— (M —m + 6) > Vo’) +e — (M — m+ .)6, where M and m 
are upper and lower bounds for u and hence for V. For 6 sufficiently 
small, w(o’) > V(o') -+ że, contradictory to Lemma 3.1. æ+ 


A fortune f is e-adequate if u(f) > V(f) — « and adequate if it is 
0-adequate, or u(f) > V(f). 


THEOREM 2. Let v. be the indicator of the e-adequate fortunes. 
For o available in T, u(e) = Vic), or o equalizes u and V, if and only 
if for every e > 0, v(e) = 1. 


Proof: As is trivial to verify, this condition implies u(¢) > V(e). 
Lemma 3.1 asserts the reverse inequality. On the other hand, if 
u(c) = V(c) and e > 0, Theorem 1 plainly implies that v.¢) = 1. ¢ 


COROLLARY 1. Ifo is available in T and almost certainly stag- 
nates, then u(c) = V(c) if and only if, for each e > 0, the fortune at 
stagnation is e-adequate with probability 1. 


The “e” in Theorem 2, unlike the one in Theorem 6.2, enters not 
because of finite additivity. 


54 Strategies [Chap. 3 


Example 1. Let F be the positive integers; '(f) = {6(f), 6(f+ 1}; 
and u(f) = 1 — /—!. Then U = 1; no fortune is 0-adequate; the 
strategy o of moving forward step by step from any fo is optimal, 
and u(e) = U(c) = 1. 


But if F is finite, the “e” in Theorem 2 can be eliminated. 


COROLLARY 2. Suppose that F is finite. Then u(c) = V(o) if 
and only if, for every stop rule ¢ and positive 6, there is a stop rule 
t’ > t such that, with o-probability at least 1 — ô, fı: is adequate. 


In a countably additive application, such as Corollary 2, the ¢ 
in Theorem 2 need range over bounded stop rules only, but this is not 
so in general. 


Example 2. Let: F be the pairs of integers f = (i, j), with? = 0,1 
and j > 0; y be a diffuse gamble on the fortunes (1,7); I'(f) = 
{6(0, 7), (1,7), y} for all f; oo = y, and on(fi, © © © , fa) = 5(fn) 
or 6(0,j,) according as n < jı or n > ji; and u(i, j) = 7. Check 
that: o is stagnant and in T at every f; ule) = 0; U = 1; and yet 
ofh: fa is adequate} = 1 for alln > 1. 


8. OPTIMAL STRATEGIES AGAIN 


As is emphasized by Theorem 5.1, every fact about thrifty and 
equalizing strategies has an implication for optimal strategies. A few 
of the implications of the preceding three sections that are not quite 
automatic, and some other facts, are here put on record. 


THEOREM 1. If no gamble in r(f), other than possibly 6(f), con- 
serves V at f, and if u(f) < V(f), then there is no optimal strategy 
for u in I at f. 


THEOREM 2. Ifa is available in r at f, persistently conserves V 
at f, and almost surely stagnates at an adequate fortune, then o is 
optimal at f. 


Proof: Apply Corollary 7.1, Theorem 6.1, and Theorem 5.1. ¢ 


There may be no optimal strategies even if each I'(f) includes 
only a finite number of y and each y is countably additive. 
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Example 1. Let F beall integers greater than —2. Let u(0) = 1, 
and u(i) = 0 for 7 #0. For 7 =0 and i = —1, I) contains 
only 6(z). For all other 7, T(z) = {6(2), èli + 1), y(2)}, where 
y(i) assigns to 0 probability 1 — ^! and to —1 probability 7}. 
Then U(i) = 1 for 7>0, but for «> 1, clearly no optimal 
strategies exist. 


Even if F is finite, provided that it has as many as three elements, 
there may exist no optimal strategies at some f. 


Example 2. Let F = {0,1,2}; TO) = {60)}, rd) = 

{6(1), (1 — n—)6(2) + n—16(0) for n = 1,2, - - - }, TQ) = 
{6(2)}; u(i) = 7, 7=0, 1, 2. There is no optimal strategy 
available in T at 1. 


The notation |p| is sometimes convenient for the number of 
coordinates of the partial history p, as in the proof of the next theorem. 


THEOREM 3. For each f, there is a strategy o available in I at f 
such that, for every partial history p (including the null one), u(o[p]) 
> inf U, and therefore inf V = inf U. 


Proof: Without real loss in generality, assume that the infimum 
of U is 0. For each f and n, there is then a policy 7,(f) for which 
u(rn(f)) > —1/n. Construct a new sequence of families of policies 
a*(f) = (o*(f), t*(f)) by induction, thus: Let rf(f) be rı(f), and for 
each f and n > 1, let r*,,(f) be the policy obtained by following the 
policy 7*(f) until it terminates, say at f’, and by then continuing with 
the family of policies z,,:(f’) in accordance with Section 2.9. For 
each f, the sequence of policies r¥ (f), 7¥(f), © - <- is such that for all 
n,allm > n, and all partial histories p, if t* (f) does not terminate by p, 
then o*(f)(p) = oX(f)(p). In particular, for each p and all sufficiently 
large n, all o*(f) prescribe the same gamble after p, say o(f)(p). 

To verify that u(o(f)[p]) > 0, let t’ be an arbitrary stop rule and 
n a large integer. Let m(h) be the first integer as large as n for which 
taf) (ph) = t’(h) + |p|, and let t(h) = thayai(f)(ph) — |p|. Plainly, 
t is a stop rule, and ł> ť. As is easy to see, u(o(f)[p], t) = 
—(n+1)—. For (¢(f)[p], 2 is the composition of a policy r” 
with the family mmny41(f’), and u(tmam4il(f’))) > — (n + 1). In fact, 
a” = (o(f)Ipl, Sal) Ph). + 
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COROLLARY 1. If V is constant, there is, at each f, an optimal 
strategy available in T. 


THEOREM 4. There is, at each f, ao available in r that equalizes 
u and V, that is, for which u(c) = Ve). 


Proof: Let u’ = u — V. Then V’ = 0, and Corollaries 1 and 
3.4 apply. + 


LEMMA 1. If wu is an indicator, o is a strategy available at some f, 
and u(elp]) > 6 for some 6> 0 and all partial histories p, then 
uls) = 1. 


Proof: For any e > 0, there is a stop rule t such that uđe) — «e < 
u(c,t) and for all t >t, u(,t’)<u@) +e. Let t =t where 
u(f.) = 1. Elsewhere let t be the composition of t with a family 
t*(-), where u(o[p], t*(p)) > 6 —e. Thenu(c) +e > uls, t) > uls, t 
+ [1 — ue, t)](6 — e) > [u(c) — e] + [1 — ue) — €](6 — e). Soule) 
> ule) + [1 — u(@)]é6 + O(e), which is impossible unless u(c) is 1. ¢ 


THEOREM 5. If u is an indicator function and V is bounded away 
from 0, then V = 1, and at each f there is an optimal strategy. 


Proof: Apply Theorem 3 and Lemma 1. ¢ 


9. STATIONARY FAMILIES 


A family of strategies ¢ was defined as a mapping from fortunes 
to strategies; ē is stationary if, for some gamble-valued function 7, 
a(f)(p) is y(l(p)) unless p is the empty partial history, in which case 
itis 7(f). Intuitively, it would seem that a gambler at his nth decision 
ought not to benefit from knowledge of his past fortunes fm for m < n. 
So perhaps there is (at least in every leavable T) a stationary family 
of nearly optimal strategies. 

A single strategy o is stationary if o[f], or more logically o[-], is a 
stationary family. Therefore, whether a single strategy o is stationary 
does not depend on a». 

There can be, at each f, a stationary optimal strategy and yet be 
no stationary family of optimal strategies. 


Example 1. Let: F be the integers; y be a diffuse gamble on the 
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positive integers; r(J) = {6(7), y, 6(—3)} forj > 0,T(7) = {6(7)} 
for j <0; u(j) = 0 forj > 0, ulj) = 1 +7 forj < 0. 


Four lemmas prepare for the first of several theorems on the 
existence of stationary families of optimal and near optimal strategies. 


LEMMA 1. For any f and positive e there is available in T at f a 
policy r = (ø, t) such that, with positive o-probability, f: is e-adequate 
and ø econserves V at f up to t. 


LEMMA 2. If F is finite, then, for some sufficiently small positive e, 
every e-adequate f is adequate. If also each I'(f) is finite, then e can 
be so chosen that also, for every f, every y in T (f) that e-conserves V at 
f conserves V at f. 


LEMMA 3. Let @ be a stationary family of strategies. If for each 
positive e there is a family ¢ of stop rules for which the ¢(f)-probability 
that fi is e-adequate is uniformly positive in f, then u(a(f)) = V(e(f)) 
for all f. 


Proof: Let y be the gamble-valued function corresponding to z. 
Apply Theorem 8.5 to the gambling problem for which r'’(f) = {7¥(f)} 
and for which wu’ is the indicator of the e-adequate fortunes and con- 
clude that V’ = 1 and therewith that ¢(f)u’ = 1. Theorem 7.2 now 
applies to (f) as a strategy available in T at f. ¢ 


LEMMA 4. If F is finite and at each f there is available in r a 
policy r(f) = @(f), t(f)) such that, with positive o(f)-probability, 
fey is an adequate fortune and o(f) conserves V at f up to ¢(f), then 
there exists a stationary family of optimal strategies. 


Proof: Every stop rule is bounded according to Theorem 2.9.1. 
If f is adequate, let d(f) be 0; otherwise let d(f) be the least integer 
such that, for some (f) of the postulated kind, ¢(f) < d(f). From 
now on, let z(f) be of the postulated kind; and let it be so chosen that 
t(f) < d(f), unless f is adequate. Let 7(f) be the initial gamble of 
o(f); ¥(f) plainly must conserve V at f. 

The stationary family of strategies ¢ determined by 7 is optimal. 
Why? If d(f) > 0, the 7(f)-probability of those fortunes f’ for which 
d(f’) < d(f) is positive. Since F is finite and d is bounded, there is 
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ane > 0 and a family of stop rules #, one stop rule for each f, such that, 
with a(f)-probability at least e, fx) is adequate. Lemma 3 now shows 
that each «(f) equalizes u and V. Theorems 5.1 and 6.1 imply that 
each o(f) is optimal. œ 


THEOREM 1. If F is finite and each I(f) is finite, then there is a 
stationary family of optimal strategies. 


Proof: Choose e as in the second part of Lemma 2. With this e, 


choose 7(f) as in Lemma 1. The hypotheses of Lemma 4 are then 
satisfied. 


The finiteness of both F and T(f) is essential for Theorem 1, as 
the examples in Section 8 amply illustrate. Still more, even if F is 
finite, no stationary strategy available at some f may be at all good. 


Example 2. Let: F = {0,1}; u(i) = i for i = 0 and 1; r(0) = 
{5(0)}, and T(1) be the set of all y such that, for some e > 0, 
y{0} = eand y{1} = 1 — e. For any stationary o available at 1, 
ule) = 0. But V(1) = 1, as is easily seen. 


We believe that if T is leavable then there does exist a stationary 


family of nearly optimal strategies, but we have established this only 
in certain special cases. 


THEOREM 2. IfT is leavable and F is finite, then for each posi- 
tive e there is available in T a stationary family of strategies ē such 
that u(a(f)) > U(f) — e for all f. 


Proof: For each f, let r(f) be available in T at f and such that 
u(r(f)) > U(f) — «e. Since, according to Theorem 2.9.1, every stop 
rule is bounded, only a finite number of gambles are used by the family 
a(f). Let I’ be the smallest leavable subhouse of I for which I’(f) 
includes all y used by any z(f’) at f. Theorem 1 applied to I’ yields 
a stationary family ¢ available in T’ such that u(e(f)) = V’(f) = 
U’(f) = U(f) — e. Of course, ¢ is available in T too. œ 


Donald Ornstein has extended Theorem 2 to the situation in which 
F is countable and each y eT(f) is countably additive but has not 
yet published his proof. Whether Theorem 2 can be further extended 
to uncountable F or to finitely additive y is not known. 
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THEOREM 3. If F is finite and there is an optimal strategy at 
each f, then there is a stationary family of optimal strategies. 


Proof: Let o(f) be optimal at f, and let e > 0 satisfy the first 
part of Lemma 2. Theorem 7.2 assures the existence of a stop rule t(f) 
such that (o(f), t(f)) terminates with positive probability at an eade- 
quate fortune which, here, is necessarily adequate. According to 
Theorem 6.3, with o(f)-probability 1, o(f) conserves V at f up to (f). 
Consequently, the hypotheses of Lemma 4 are satisfied. ¢ 


The finiteness of F is essential for Theorem 3. For infinite F 
there can be optimal strategies at every f and yet no stationary 
optimal strategy at any f. This can happen even if every gamble is a 
one-point gamble and T is leavable. 


Example 3. Let: F be the integers; r(j) = {6(7), 6(7 + 1), 6(—7)} 
for j 2 0; T(J) = {6(9), 6(7 + 1)} for j < 0; u(j) = 0 for 7 = 0, 
ulj) = 1+ 97> forj < 0. 


The finiteness of F in Theorem 3 cannot be relaxed even if T 
is leavable and there is an optimal policy (not merely an optimal 
strategy) at each f, and even if the conclusion is weakened to assert 
only the existence of an optimal stationary strategy at each f. 


Example 4. Let F be the pairs of integers f = (i, j), with z = 0, 
1, 2, and j >È 1. Let y be a gamble that attaches probability 
277 to f = (1,7) and vy’ be a diffuse gamble on the fortunes (1, 7). 
Let r(0, j) = {8(0, 9), 6(2,9), Y}, 20,9) = {8(1, j), 82,3), 7}, and 
P(2,9) = {8(2, j)}. Let ul, j) =i— j. Leto = y, of) = 
y'ifiîı = land ô(fı) otherwise; oe(fi, fe) = (2, J2); on( f, © © * fa) 
= ô(fa) if n > 2. The strategy o thus defined is available in T 
at (0,7) and u(c) = 2 = sup u; so ø is optimal. In fact, optimal 
policies for each initial f are easily defined. But no stationary 
strategy in T at (0,7) is optimal. 


If there is complete absence of any stochastic element, . the 
gambler can restrict himself to stationary families without macro- 
scopic penalty. A house T is deterministic if each y in every I(f) 
is 6(g) for some g. A strategy o available in T at f is strongly optimal 
at f, if lim u(c, t) (not only lim sup u(ø, t)) is V(f). 
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THEOREM 4. If I is deterministic, then the existence of a sta- 
tionary family of optimal strategies is implied by each of these two 
conditions: 

(a) u assumes only a finite number of values. 

(b) There is at each f a strongly optimal strategy. 


Proof: Since the two parts of this theorem have similar proofs, 
only that of Part (b) (which is, if anything, the more difficult) is given 
here. 

Every strategy available in T is 6(h) for some history h = 
(fı, fa > * +). Choose for each fo a strongly optimal strategy 6(h). 

Suppose first that for each f’ there are at most a finite number of n 
for which fa = f’. Define a sequence ff, ff, - - - inductively, thus: 
Let f = fo, and let f*,, be f;, where 7 is the smallest integer such that 
firi ¥ fž for all ¿ > 0. As is easily verified: f* = ff for0 <i <j; 
for each 2, there is a j such that f* = f; and fA, = fj+ı; and 6(h*) is 
a stationary strategy that is strongly optimal for fo, where h* = 
(ff, Taye? 2s 

Suppose next that there is an f’ such that, for an infinite number 
of Nn, fa =f’. Since 6(h) is strongly optimal, u(f’) = V(fo). It 
requires but modest effort to define a sequence f, f¥, - - - with the 
following properties: (i) ff = fo; (ii) for every z there is a 7 such that 
ft = f; and fi. = fis; (ili) if fF = ff, then ft. = fia; and (iv) for 
an infinite number of 1, ff =f’. Let h* = (ff, ff, -- +). Then (i) 
and (ii) imply that 6(h*) is available at fo since 6(h) is. According to 
(iii), 6(h*) is stationary, and 6(h*) is seen to be optimal according to 
(iv). Thus, there is a stationary family of optimal strategies defined 
at least fora nonempty subset Gof F. By Zorn’s lemma (Kelley 1955), 
there exists a maximal such family. It is easy to see that such a 
maximal family is necessarily defined for all of F. ẹ 


Since any bounded u can be approached uniformly from below 
by a u’ with only a finite number of values, Part (a) of Theorem 4 
has this corollary: 


COROLLARY 1. If I is deterministic and e is positive, there 
is available a stationary family of strategies ¢ such that u(a(f)) = V(f) 
— e for all f. 


Example 3 illustrates the need for some condition like (a) or (b) 
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in Theorem 4. If I in Theorem 4 is also leavable, the proof is simpli- 
fied, and (b) then implies the existence of a stationary family of strongly 
optimal strategies. But without leavability the conclusion cannot 
be thus strengthened, as easy examples show. 

Theorem 4 can of course be interpreted as facts about directed 
graphs. These facts may previously have been observed in that 
context. 


THEOREM 5. If each I(f) contains at most one gamble a(f) in 
addition to 6(f), then the stationary family determined by 


_ { ef) for adequate f if 5(f) is available 
(1) Wf) = | a(f) for other f 


is optimal. 


Since this theorem is so special and will not be used in this book, 
we do not give a proof. There may be no optimal strategy at some f 
if some I'(f) contains as many as three elements, as is illustrated by 
Example 8.1. 

The next theorem, though immediate from earlier results, is 
recorded because it is applicable to the two-armed (or n-armed) 
bandit problems with future incomes discounted as described in 
Section 12.5. 


THEOREM 6. If at each f there is available a V-conserving y, as 
for example when there are only a finite number of y available at each f, 
and if every available strategy equalizes u and V, then there is a 
stationary family of optimal strategies. 


4. 


1. 


CASINOS WITH FIXED 
GOALS 


INTRODUCTION. Almost all the specific gambling problems 


treated in this book involve gambling houses of a special kind, 
to be called casinos, and very special utility functions, called fixed 
goals. The problem of a casino with a fixed goal will be described 
and studied generally in this chapter to prepare for more specific 
problems in later chapters. 

The gambler’s fortune in a casino in the technical sense to be 
introduced here is simply the ‘‘money” available to him (in 
cash or credit); thus F = [0, <). Informally, the rules that 
distinguish a casino from gambling houses more generally are 
these: The gambler cannot stake what he does not have; a rich 
gambler can do whatever a poor one can do, though not neces- 
sarily on a larger scale; and a poor gambler can, on a small scale, 
imitate a rich one. 

To put these rules formally and to exploit them, it is con- 
venient to have a compact nomenclature for the homothetic 
images of a gamble y on the real numbers (not necessarily one 
on [0, ©)). For real a and b, let [ay + b] be the gamble such 
that 


(1) [ay + ble = | z(af + b) dx(f) 
for all bounded, real-valued functions z of the real variable f; 


equivalently, the [ay + b]-probability of the set aS + b is the 
63 
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y-probability of S. Let @(f) be the set of random displacements 
or lotteries available at f. That is, 0 e O(f) if and only if, for some 
y Eer(f), y = [0 + f]. Clearly, 6(— ©, 2] is the probability of win- 
ning at most x when using y at the fortune f, for it equals y(— ©, f + a]. 

The rule that the gambler cannot stake more than he possesses 
means that the probability of his fortune’s becoming negative must 
be 0, and this is already implicit in the definition F = [0, œ). The 
rule that a rich gambler can do whatever a poor one can do means that 
O(tf) C @(f) for0 <t < landO < f. The rule that the poor gambler 
can imitate a rich one on a small scale means that, for0 < ¢ < 1 and 
0 <f, O(f)] C O(tf), where [t@(f)] is, of course, the collection of all 
[t0] for 0e O(f). For simplicity, it is also made part of the formal 
definition of a casino that only 6(0) is in r(0). 

Certain casinos as technically defined can, with a grain of salt, 
be taken as good models of real-world casinos. The main difference 
seems to be that, because of the discrete nature of real money or 
gambling chips, only a finite number of homothetic images of a 
gamble are actually available in a real-world casino. 

The gambler at a casino will be said to have a fixed goal if his 
only desire is to obtain at least a certain fortune. It is often con- 
venient to let the unit of money be this goal fortune. Henceforth, 
unless the contrary is explicitly stated, the gambler at a casino will be 
understood to have a fixed goal at 1; thus u(f) = 0 for0 < f < 1, and 
u(f) = 1 forf > 1. 


2. THE CASINO INEQUALITY 


An easily derived inequality practically characterizes the func- 
tions U for which U(f) is the optimal probability of attaining the goal 1 
in some casino, beginning at f. To express this inequality, and for 
many other purposes, it is convenient to write Z for 1 — z, where x 
is a number. 


THEOREM 1. U defined on [0, ~) is the U of some casino (with 
fixed goal 1) if and only if0 < U(f) < l forf > 0,U(0) =0,U(f)=1 
for f > 1, and 


(1) U(fg + fh) > U(f)UGQg) + U(f)U(h) 


forO<f<landO<heg<l. 
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The proof is given in two parts after two easy lemmas. 


LEMMA 1. Ina casino, O(fg + fh) D [(g — A)O(f)] foro <f <1 
and0 <he<g<h+l1. 


LEMMA 2. If 0 < U(f) <1 for f >0, U(f) =1 for f >1, and 
(1) obtains for0 < f < landO < h < g < 1, then U is nondecreasing 
in f, and (1) obtains under the more general conditions 0 < f and 
O<h<g. 


Proof of necessity: If U isthe U of a casino:0 < U(f) < 1 because 
U(f) is a probability; U (0) = 0 because only 6(0) is in r(0); U(f) = 1 
for f > 1, because if f > 1, the gambler can attain his goal by stag- 
nating immediately. 

Finally, to see the necessity of (1), argue thus: If the gambler 
has a fortune fg + fh between h and g with g > h, he can find a policy 
that will leave him at least as high as g with probability almost U(f) 
without taking him lower than h. This is so simply because in view 
of Lemma 1 he can, so to speak, imitate on a small scale a policy 
leading from f to at least 1 with probability nearly U(f). After this 
first phase, let the gambler then imitate a nearly optimal policy 
beginning at g if he finds himself as high as g, or otherwise let him 
imitate one beginning at h. The two phases together will leave him 
above 1 with at least almost the probability given by the right side 
of (1). The condition is therefore necessary. The argument can of 
course be written more formally if less clearly; see the contexts of 
(2.9.3) and (2.9.7). 


Proof of sufficiency: The proof of sufficiency will actually show 
that a function which satisfies the conditions is the U of some casino 
such that I'(g) includes for every g in [0, 1] the gamble which assumes 
the value 1 with probability U(g) and 0 with probability U(g). Call 
this gamble y, and let 6, = [y — g] be the corresponding lottery. 
For each f > 0, let O(f) be the set of all lotteries [t6,] for all g in [0, 1] 
and all ¢ such that 0 < ig < f. Check that r(f) = [O(f) +f] is a 
casino. Now Theorem 2.12.3 applies to show that U is the U of this 
casino, thus: First, the value U(f) can be attained by a stagnant 
strategy of one move; ysu = U(f)u(0) + U(f)u(1). This is U(f), as 
it should be, since u(1) = 1 and u(0) = 0. However, for tg <f, 


[vo + (f — tg)]U = Ug)UCF + tg) + UG)UCS — tg) 
< U(g(f + tō) + g(f — tg)) = UCP). 
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This inequality is given directly by the hypothesis if f + tg < 1 and 
g < 1, and by Lemma 2 in all cases. œ 


The proof obviously also shows that the smallest casino such 
that 6, e @(g) also has U as its utility. 

In view of Theorem 1, it is easy to verify that the collection of 
functions U(f) that are the U of some casino are a semigroup under 
composition. That is, if U(f) and V(f) are such functions, then so 
is U(V(f)). 

A natural one-parameter semigroup of casino functions are the 
functions min (f*, 1) for a > 1. The essential step to verify that 
these are casino functions, by means of Theorem 1, is to check the 
inequality 


(2) fo + fh > [feg + (1 — fhe} 


for f in [0,1] and O < h < g. Equality obviously obtains in (2) if 
fisOorlorifg =h. Ifh < g, the right side of (2) is strictly convex. 
Therefore the inequality obtains, as asserted, and is strict except in the 
cases specified. Interesting casinos with min (f*, 1) as casino func- 
tions are mentioned at the end of Section 9.3. 


3. EXPLORATION OF THE CASINO INEQUALITY 


What does the casino inequality (2.1) imply about casino func- 
tions, that is, functions that are the U of a casino in the interesting 
rangeQ <f <1? 

It is convenient to explore the casino functions in terms of two 
inequalities simpler than (2.1) that follow from (2.1) and from the 
fact that 0 and 1 are fixed points for U. 


(1) U(fg) = U(fg + fo) 
> U(f)U(). 
(2) U(fg) = 1 — U(1 — fg) 
= 1— U(fl + f9) 
<1-— U(f) — ÙU) 


U(f)U(§). 
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The final form of (2) looks especially pretty with (1), but the following 
form is also useful. 


(3) U(f +g — fg) = U(f) + Ug) — U(f)U(g). 


Though (1) and (2) do not imply the casino inequality, as will be 
shown in Section 8, they lead to several interesting properties of casinos. 
Anything true of all bounded, nonvanishing solutions of (1) and (2) 
is a fortiori true of the U of any casino. 

Inequalities (1) and (2) point to the answer to an incidental 
question: “For what casinos does equality hold in every instance 
of the casino inequality (2.1)? For the U of such a casino, equality 
would hold throughout in (1) and (2). It is not difficult to verify that 
the only bounded solutions in the interval [0, 1] of the identity cor- 
responding to (1) are the constants 0 and 1, the indicator functions of 
(0, 1] and of {1}, and functions of the form f, a > 0. The same 
reasoning applied to (3) requires U to be one of the same four indicator 
functions or ff, 8 >0. The functions compatible with both con- 
straints are only the four indicator functions and f. Of these, all 
but the constants 0 and 1 are casino functions. The function 0 
pertains to no casino since it is not 1 at 1; the function 1 pertains to no 
casino since it 1s not 0 at 0. 

Inequalities (1) and (2) separately imply, for every positive 
integer n, 


(4) U(f") = U(f), 
(5) U(fr) < (0. 


The case n = 2 shows that U(f) > 0 for all f, that is, for all f in the 
range of interest [0, 1]. Also U2(0) < U(0), Ū(0) < U2(0); so U(0) 
= 0 or 1, and similarly U(1) = 0 or 1. 

If U(1) = 0, then, according to (3), 0 = U(1) = U(f +1 —f-1) 
> U(f) = 0, so that U is identically 0. The function 0 is of course 
a solution of (1) and (2) (and even of (2.1)), though it pertains to 
no casino. 

If U(0) = 1, then, again according to (3), U(f) = U(f +0 —f-0) 
> U(f) + U(0) — U(f)U(0) = 1; so U(f) > 1. One such solution 
is the function 1. Obviously none could pertain to any casino. All 
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solutions of (1) and (2) that exceed 1 somewhere are necessarily 
unbounded near f = 0, as (4) shows. There are unbounded solutions 
of (1) and (2). For example, let U(0) = 0 and U(f) = f~ for f > 0; 
then U(fg) = U(f)U(g) for f, g > 0, and U(f) <0 for 1 >f > 0, 
which makes (1) and (2) evident. This function also satisfies (2.1). 

To sum up, the bounded solutions U of (1) and (2) are confined 
between 0 and 1. Apart from the two exceptional ones U = 0 and 
U = 1, they all satisfy U(0) = 0 and U(1) = 1. From now until 
further notice, assume that U is a bounded solution of (1) and (2), 
with U(0) = 0 and U(1) = 1. 

Such a U is nondecreasing in f. In fact, fO<g<ft+g< 1, 
then g/f < 1, and, according to (3), 


U Dis e) 
(r 13 


U) +U (3) - UHU ($) 


U(f) + UU ($) 


(6) U(f + 9) 


IV 


This not only proves the required monotony but shows that it is 
strict at f from the right unless U(f) = 1 or U(h) = O for some posi- 
tive h. These exceptions can occur, but only in very special ways. 
First, if U(f) = 1 for some f with 0 < f < 1, then (4) shows immedi- 
ately that U(f) = 1 for some arbitrarily small f, and therefore U(f) = 1 
for all positive f in view of the demonstrated monotony. If U(h) = 0 
for some positive h, then (4) applied to A!” shows that U(f) = 0 for all 
f <1. Thus U is either 1 in (0, 1) or 0 there (which are real possibili- 
ties), or else it is strictly increasing throughout [0,1]. (Incidentally, 
(1) cannot be used instead of (3) to prove monotony here.) Assume 
from now until further notice that U is strictly increasing. 

Under the assumptions now in force, U is demonstrably continu- 
ous. First, U is continuous at 1 because, for any f in (0, 1), (5) is 
impossible unless U(f*) approaches 0 as required. Substituting f” 
for f in (5) shows that U is also continuous at 0. Iff > g > 0, then 


T) 0< UG) -U@ = UG) — u (s8) < UQ) f = u (2) | 
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which proves continuity in view of the established continuity at 0 
and 1. 

As will be shown next, U(f) > f is impossible for a strictly 
increasing solution of (1) and (2). Let g maximize U(f) — f, and 
suppose U(g) = ag > g. Then U(g") > ag”, and 


U(g + gg”) — (g + gg") > [U(g) — g) + Ug) U(g") — gg” 
> [Ug) — g] + [U(g)a” — g]g”. 


Since U(g) > 0 and g > 0, the left member of the sequence of inequal- 
ities exceeds U(g) — g for large n, which is a contradiction. 

The possibility U(g) = g for some g, 0 < g < 1, is not excluded, 
but if it occurs once, it occurs everywhere, as will be shown. This 
possibility does pertain to a casino, according to Theorem 2.1; a 
specific example is the casino in which all fair, and none but fair, 
gambles are permitted, as is not hard to see. If U(g) = g, then 
U(g") => g”; but inequality here has been shown to be impossible, so 
U(g") = g”. Dually, U((g")) < (U(g))” = 9"; so U(1 — g) = 1 — 
g". Now, U(f) =f for every f of the form 1 — (1 — g”)*. These 
numbers are everywhere dense in [0, 1], and since U is continuous, the 
assertion is proved. 

Once attention is focused on strictly increasing functions, which 
has been justified by study of (1) and (2) without the stronger inequal- 
ity (2.1), the casino inequality (2.1) and its consequences (1) and (2) 
can be couched in a particularly graphic and suggestive form. 


U(fg + fh) — U(h) 
(8) — U@) — Uh) > U(f) 


forO <f<landO<h<g<l. 


U(fg) 
(9) Ti) > U(f) 
and 
U(f + fg) — Ug) 
(10) a 2717, aa > U(f) 


fr0<f<1,0<g< 1. Inequality (8) says that, if any segment 
of the graph of U is linearly transformed horizontally and vertically 
so as to be 0 at f = 0 and 1 at f = 1, then the transformed segment 
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never descends below the graph of U; (9) and (10) say the same, 
but only for segments beginning at 0 and for segments ending at 1, 
respectively. 

With this graphical interpretation, it is particularly easy to see 
that the inequalities put certain constraints on the derivatives of U. 
To express these, let U* and Ux, *U and U denote the upper and 
lower right, and upper and lower left, derivatives of U. Then (8) 
implies two pairs of inequalities: 


+79) | U(g) — U(r) | *U(1) 
oe Uol gor “la 
and 

U*(h) | — U@ — Uh) © { U*0) 
(12) Ua(h) ge. | U.(0) 


forO <h<g<l. 

Setting h = 0 in (11) and g = 1 in (12) gives two pairs of inequal- 
ities that are implied separately by (9) and (10) and, therefore, 
by (1) and by (2). Letting h approach g in the upper part of (11) 
and g approach h in the lower part of (12) leads to the inequalities 
«U(g)/*U(g) = 1/*U(1) and Us(g)/U*(g) > Ux(0). (Letting h 
approach g in the lower part of (11) and g approach h in the upper 
part of (12) leads only to the conclusion that U*(0) < 1 < +U(1), 
which has already been proved in the stronger assertion that U(f) < f 
for all f.) Possibly more than (11) and (12) can be inferred about 
the regularity of U, but examples in later chapters will show that U 
can, for instance, be a singular monotonic function, and so it is danger- 
ous to expect too much regularity. On the other hand, it is not 
unusual for U to be analytic, as the functions f* for a > 1, and other 
examples in later sections, illustrate. 

An illustrative application of (12) was brought to our attention 
by Lawrence Jackson and Roger Purves. For what values of a 
greater than 1 and of à strictly between 0 and 1 is the convex combina- 
tion Af + dAf* of the two casino functions f and fe itself a casino func- 
tion? Part of the answer follows on applying (12) with g = 1 to 
conclude that 


1 — Ah + ihe) , 


1 hahe-! > 
(13) A + rAah*1 > lh 


Sec. 3] Exploration of the casino inequality 71 


if Af + ìfe is a casino function; for (13) is false for small h if a 
exceeds 2. 

Jackson has shown that Af + Af* is a casino function for 1 < a < 2. 
His result is proved as Theorem 8.5.6. 

The first special casino inequality, U(fg) > U(f)U(g), can be 
viewed as a multiplicative expression of subadditivity. This leads 
to the information that U approximates a monomial near the origin. 
Let V(z) = — log U(e-*) for nonnegative z. Then, V is continuous; 
z < V(z) and F(z +w) < V(z) + V(w) for all nonnegative z and w. 
According to a theorem on subadditive functions (see, for example, 
(Hille and Phillips 1947, Theorem 7.6.1, p. 244)), V(z)/z approaches a 
as z approaches œ, where 1 < a = inf (V(z)/z). This means that 


(14) Peay ss; 


where the first inequality holds for all positive f less than some positive 
fo which depends on the positive number e, and the second inequality 
holds for all f in [0, 1]. Of course, 


(15) CaaS int PEA for f in (0, 1). 


From a somewhat similar use of (2), or from a duality principle 
spelled out in Section 6, the dual conclusions follow. That is, for 
some unique £ in (0, 1] 


(16) Pf SUGy aI 


where the first inequality holds for all f in [0, 1] and the second holds 
for all f in (fı, 1), where fı depends on the positive number e. For 
later reference, 


(17) 1 > 8 = sup ee for f in (0, 1). 


Whether the full casino inequality implies much more about the 
behavior of U near 0 and 1 we do not know. But it seems doubtful, 
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for example, that the strict inequality in (14) can be strengthened to 
kfe < U(f) for some positive k. 


4. THE THREE SPECIAL TYPES OF CASINOS 


Some of the conclusions of this chapter thus far can be put as 
follows. There are three special U’s that pertain to casinos: U and 
its casino are trivial, fair, or superfair according as U(f) = 0, f, or 1 
for f in (0, 1). All other U’s that pertain to some casino rise strictly, 
monotonically, and continuously, from the point (0, 0) to (1, 1) with 
U(f) < f for f in (0, 1), and subject to the inequalities (3.8) through 
(3.12), and are the U’s of the subfazr casinos. Thus casinos fall into 
three special types and a general type. 

What are the conditions on the lotteries available in a casino 
that determine to which of the types the casino belongs? Much 
of the answer can be presented immediately. However, the full 
distinction between fair and subfair casinos remains for Chapter 11. 

Trivial casinos. A casino is trivial if and only if all probability 
of macroscopic gain is excluded, that is, 0(e, ©) = O for all positive e 
and all 9 in @(1) (equivalently, for all 6 in some @(f) for f > 0). 


Proof: The condition is obviously necessary; it is sufficient in 
view of the basic Theorem 2.12.1. ¢ 


Superfair casinos. A casino is superfair if and only if @(1) 
(or, equivalently, O(f) for all f > 0) contains a superfair lottery 9, 
that is, one for which f min (z, k) d6(x) > 0 for some positive real 
number k. 


Proof: The condition is necessary. For without it, the function 
Q(f) = min (f, 1) majorizes U according to the basic Theorem 2.12.1. 

Suppose now that @(1) (and therefore every @(f) for f > 0) con- 
tains superfair lotteries, but that T is not superfair. A contradiction 
arises thus. Since I is not trivial, U is continuous and strictly increas- 
ing, and U(f) < f. Consequently, U restricted to [0, 1] is supported 
from below by some line of slope 1; thus there is a smallest nonnegative 
number a such that U(f) > f — a for all f in [0, 1], and a g in (0, 1) 
such that U(g) = g — a. If 0 is a superfair lottery in ©(1), [t9] isin 
©(g) for 0 < t < g, and, for sufficiently small t, U fails to be excessive 
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for [g + t6] according to the following calculation. 
Q) = fg + elu = f Ug +2 dto 


> f min (g + z — a, 1) d[té](z) 


g— a+ | min (z, 1 — g + a) ditol(e) 


U(g) + | min (e, Og) altal) 


U(g) +t f min ę o do(z) 


> U(g) 
for small positive t. This contradicts Theorem 2.14.1. @ 


Fair casinos. Of course, for T to be fair it is necessary that 0(1) 
contain no superfair lotteries. In the presence of this necessary con- 
dition, it is natural to expect that T is fair if @(1) contains a fair 
lottery, that is, one for which 


(2) lim | min (z, k) d6(x) = 0. 
k © 


This condition is not necessary; for clearly T can be fair if @(1) con- 
tains no fair gambles but does contain arbitrarily good facsimiles of 
them. Of greater interest, U(f) can be strictly less than f in (0, 1) in 
the presence of a fair, nontrivial lottery, that is, one for which 0(—e, e) 
< 1 for some e > 0 (shown in Section 11.2). As is to be expected, 
if a fair, nontrivial 9 has bounded support so that 6(k, ©) = 0 for some 
k > 0, every casino containing 9 is at least fair. A technique showing 
that some fair 0 with unbounded support also generate fair casinos 
will be illustrated here, though this technique will be largely superseded 
in Section 11.3. 
It will be shown that if (2) is replaced by the stronger condition 


_ f min (f,®) a0) | 
8) = ko(k, ©) = 
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then the casino is fair. Since (3) is equivalent to 


(4) lim gage) ree FAH = 1, 


(3) says that the conditional expectation of the gambler’s gain, given 
that it exceeds k, is k + o(k). If, for example, 6(k, ©) = e-*-! for k 
in (—1, ©), then the fraction in (3) is k7}. 


Proof: Suppose that U(f) < f for f in (0, 1) for a casino that 
includes a 0 satisfying (3). Let œ and g be as in the discussion of 
superfair casinos, and calculate much as in (1), but taking advantage 
of (4) and of the fact that U(g) > g. 


(5) lg + ve = | UG +2) dee) 


= Joc U(g + z) a[t6](z) + [ta], œ) 


IV 


ig (U(g) + z) d[t6}(z) + [t8](g, ©) 


Ul) + f,- e Ae) + OOG, ©) 


U(g) +t Joep pn? OO -+ doe ($ 3 


<q? 282) + —> d ($ 3) 


U(g) +t | Jian? BO p VW AO) @ (2) 0 @ 3) 


> U(g) 


uo +l) 


2 


for small positive t. But this contradicts Theorem 2.14.1, as he- 
fore. @ ` 


The U of a casino T is not necessarily determined by ©(1) (or 
any other @(f)) alone. But whether T is of one of the three special 
types—and if so, of which type it is—is determined by @(f) for any 
positive f. So far as trivial and superfair types are concerned, this 
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fact is now evident. For fair casinos it is less evident and will be 
shown in Section 11.3. 


5. HOW NICE CASINOS ARE 


We have been working throughout at such a level of generality 
that the gambles y may be only finitely additive. On this account 
it must be asked whether bizarre things do not happen. Are bounded 
stop rules nearly adequate, or can U, really be less than U? To 
what extent do the probabilities that the gambles y assign to the non- 
Borel sets affect the value of U? Theorem 1 and Corollary 1 show 
that with respect to these questions casinos behave quite nicely. 


LEMMA 1. The casino inequality holds for U.. 


Proof: Same as for U. @ 
An interval is any connected set of real numbers. 


LEMMA 2. If ¢ is a bounded monotone function and y is any 
(finitely additive) probability measure defined on subsets of the real 
line, then y¢ is determined by the values that y assumes on the 
intervals. 


LEMMA 3. Each Um of any casino is a nondecreasing function 
of f. 


Proof: Use the hypothesis that a rich man can do whatever a 
poor one can, and the fact that u = Uo is monotone nondecreasing. 
Proceed by induction, using Theorem 2.15.2. æ 


THEOREM 1. In every casino, U. = U. 


Proof: Lemma 1 implies that U, is continuous or is one of the two 
discontinuous casino functions of Section 4. If U., is continuous, use 
Lemma 3 and apply Theorem 2.15.5, part (e). If U.(f) = 0 for 
0 < f <1, then all probability of a macroscopic gain is excluded. 
Use Theorem 2.12.1 to conclude that U(f) = Ofor0 < f < 1. Lastly, 
suppose that U.(f) = 1 for0 <f <1. Since in all houses U., < U, 
and no U exceeds this U.s, Us = U. ¢@ 
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Theorem 1 implies that a gambler with a fixed goal in a casino 
can restrict himself to bounded stop rules without suffering appreci- 
able loss. 

Two gambles y and y’ are companions if yẹ = y'ẹ for all bounded 
continuous 4; two houses T and I’ are companions if, for all f and every 
y in I(f), there is a companion of y in I'’(f), and vice versa. To say 
that U is determined by the values that the gambles in T assign to 
continuous functions is to say that U = U’ for every companion T” 
ofr. 


THEOREM 2. Ina casino, U is determined by the values that the 
gambles assign to continuous functions on [0, ©). 


Proof: If U and the U’ of a companion I’ of T are continuous, 
then, for y e T(f), yU’ = y’U’ < U"(f) for some y’ in I'’(f), according 
to Theorem 2.14.1. Thus U’ is excessive for T so that, according 
to the basic Theorem 2.12.1, U’ > U. Similarly, U’ < U;soU’ = U. 
Suppose next that U is one of the two discontinuous casino functions. 
If U is superfair, there is, according to Section 4, a 0 in @(1) and a 
positive k for which f min (f, k) d6(f) > 0. Since min (f, k) is con- 
tinuous in f, there is a companion of 0, say 6’, in @’(1) such that 
f min (f, k) d6’(f) > 0, which, again according to Section 4, implies 
that U’(f) = 1 for f>0. A similar argument shows that, if U is 
trivial, so is U’. ¢ẹ 


COROLLARY 1. The U of a casino is determined by the proba- 
bilities that the gambles assign to the intervals. 


It is almost routine to introduce notions of convergence for 
gambling houses, and it is natural to inquire to what extent U varies 
continuously with T and u. Even for casinos with the usual u there 
is not full continuity; for a sequence of superfair casinos can converge 
to a fair one. This may, however, be the only source of discontinuity 
for casinos with the usual u. 


6. THE CASINO-FUNCTION SEMIGROUP 


As was mentioned after the proof of Theorem 2.1, casino functions 
form a semigroup with respect to substitution. To study this semi- 


Sec. 6] The casino-function semigroup 77 


group, let UV, in this section, denote the function for which (UV)(f) = 
U(V(f)). The two casino functions that are not strictly increasing 
are of little interest for the rest of this section; so usually let ‘‘casino 
function” mean “‘strictly increasing casino function”, which does not 
interfere with the semigroup property. 

If the graph of a U in the casino semigroup is regarded also 
as the graph of a function of the variable 1 — U into 1 — f (by looking 
at it sideways from the rear, so to speak), the new function is alzo a 
casino function, as the discussion of (3.8) brings out. Analytically, if 
U is in the semigroup, so is U*, where 


(1) U*(f) = 1— U-"(1 — f). 

Since 

(2) U= UI —f)) =1-U7(U01 —f)) =f, 
(3) (OF) Nf) = 1 — U(1 — f) 


or (U*)* = U. Accordingly, U* is called the dual of U. 
What is (UV)*? 


(4) (UV) = 1 = (UV) =) 
1 = V(U = 7) 
1 -= V1 ~~ Ud — f) 


= V*(U*(f)); 


so (UV)* = V*U*, or the duality operation is an anti-automorphism. 
In particular, UU* and U*U are self-dual. Similarly, the dual 
of any strictly increasing solution of either of the special inequalities 
(3.1) or (3.2) solves the other. Thus the intersection of the two semi- 
groups of strictly increasing solutions of these inequalities is a semi- 
group that is closed under the duality operation *. 

Composition and the duality operation are not the only ways 
to construct new casino functions out of old ones, as the next theorem 
implies. 


THEOREM 1. The infimum of casino functions is a casino function. 
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Proof: Suppose that U = inf U, and that 
U.(fg + fh) > U.(f)Ua(g) + Ua(f)Ua(h). 


Then U(fg + jh) = inf Ua(fg + fh) > inf (Ua(f)Ua(g) + Ue(f)Ue()] 
> inf [Ua(f)UG) + Ua(NU@)] > UHUU) + NUM). ¢ 


COROLLARY 1. If a collection of casino functions is bounded 
away from 0 at a single point of the open interval (0, 1), then it is 
bounded away from 0 at every point in (0, 1). 


(Corollary 1 is sharpened by Theorem 6.7.1.) 

Since the minimum of two casino functions is a casino function, 
it may be interesting to observe that the operation of forming the 
minimum commutes with the operations of right and left composition: 
U min (V, W) = min (UV, UW); min (V, W)U = min (VU, WU). 
In the typical case when the functions are strictly increasing, so that 
the duality operation is meaningful, it, too, commutes with the opera- 
tion of forming the minimum; min (U, V)* = min (U*, V*). If U*-is 
chosen for V, it is clear that min (U, U*) is self-dual. Thus each 
casino function U immediately determines three (typically distinct) 
self-dual casino functions UU*, U*U, and min (U, U*). 

Many of the remarks above are very general and apply if U and V 
are arbitrary order-preserving homeomorphisms of the unit interval 
onto itself. 

Starting with the monomials U.(f) = fe, which are casino func- 
tions for a > 1, interesting examples of other casino functions and of 
relations among them are easily derived: U.Us = Uag; Ua(f) = 
1 — (1 — f)¥*; UU = Užs; (UzUs)(f) = 1 — (1 — fP)¥*; UsUa = 
= ee eee 

In particular, the self-dual functions U2U., and U«Už are different 
from each other if a> 1. The point (f, W) is on the graph of the 
former if and only if 


(5) fe+(l1-Wye=1 
and on the graph of the latter if and only if 


(6) (1 — f)" + Wile = 1. 
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For all a > 1, the first exceeds the second, at least for small f. For 
a = 2, the first graph is a circular arc, and the second is a parabolic one. 
The third natural self-dual casino function associated with Ua, namely, 
min (Ua, U2), is different from the other two since it is not everywhere 
analytic. 

In Sections 9.2 and 9.4, a neat, self-dual, one-parameter semigroup 
arises naturally. It consists of the functions V., a > 1, where 


ye S 
(7) Va(f) = —— ay 


It is easy to verify directly that Va = Vz and Vig = VaVg. It is not 
difficult to give a direct proof that the V« are casino functions, and 
indirect ones are in Sections 9.2 and 9.4. 

It sometimes happens, as later chapters illustrate, that, when an 
interesting casino has U as its casino function, some other casino 
naturally suggested by the first one has the dual U* as its casino 
function. It would therefore be interesting to formulate a concept 
of the dual of a casino, not merely the dual of a casino function, and 
even a concept of the product and infimum of two casinos correspond- 
ing to the composition and infimum of their casino functions. Our 
efforts on these three problems have not met with success. 

If T and T* are casinos with dual utilities U and U* different 
from each other, then each is genuinely preferable to the other for 
some initial fortunes; that is, there are f and g such that U(f) > U*(f) 
and U*(g) > U(g); for the areas under U and U* are the same. 

There may be some interest in examples cf functions that satisfy 
the casino inequality (2.1) but do not coincide in [0, 1] with the U 
of any casino: constant functions, linear functions U(f) = a + 6f with 
—aZ and (1 — a — 8) both nonnegative (except that a = 0 and 
6 = 1 yields a casino function), any strictly decreasing function that 
is never exceeded by 1, and U(f) = f~! for 0 < f < 1 and U(O) = 0. 


7. RICH MAN’S, POOR MAN'S, AND 
INCLUSIVE CASINOS 


In any casino, a gambler can imitate a richer one on a small scale; 
casinos in which he can also imitate a poorer one on a large scale, so 
that the amounts he is allowed to stake are proportional to his wealth, 
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are of special interest. Formally, a rich man’s casino is one in which 
if the lottery 0 is available at f then t0 is available at tf for all ¢ > 0. 
In a rich man’s casino, U(f) is the supremum of the probability not 
only of attaining the goal 1 from the initial fortune f but also of attain- 
ing the goal f~! times any initial fortune. 


THEOREM 1. These conditions on a casino T are equivalent: 
(a) T is a rich man’s casino. 
(6) O) = [fO]. 
(c) O(tf) = [tO(f)] for t > 0. 
(d) [@(f)] C OY) for t > 0. 
(e) O(P] C OG) for t > 1. 


Real-world casinos do not seem to be rich man’s casinos. On the 
other hand, a real-world casino, by and large, offers to a poor man any 
bet offered to a rich man provided that the poor one can afford it. In 
a poor man’s casino, if 0 < f < f’, 6€O(f’), and 0(—~, —f) = 0, 
then 0€ ©(f). Trivially, for every f > 0 and z > 0, every strategy o 
available at f + z, when translated by —z, is available at f, provided 
that o always uses gambles attaching probability 1 to (x, œ). Unless 
@(1) contains a 0 other than 6(0) for which 6[0, ©) = 1, it is enough 
of a proviso that o use only gambles attaching probability 1 to the 
interval [z, ©). 

Because the poor man in a poor man’s casino can translate the 
modest strategies of a richer man as described, the probability with 
which a gambler can increase his fortune from f + z to g + x without 
ever falling below h + x is independent of x forO0<h<ht2zcds 
ftx<gt+ex. If 60, ©) = lonly when 6is 6(0), the same argument 
applies even if z = 0. (As a matter of fact, the argument can be 
modified to cover x = 0 for every poor man’s casino.) 

Casinos in which a gambler may stake any amount that he 
possesses on any game played at the casino are of particular mathe- 
matical simplicity. An inclusive casino is a casino such that, for all 
positive t, f, and g, if 6 € O(f) and [t6](— œ, —g) = 0, then [#6] € O(g). 
A necessary and sufficient condition for a casino to be inclusive is 
that it be both a rich man’s and poor man’s casino, as is easily verified. 
The proof of Theorem 2.1 shows that every casino function is the U 
of an inclusive casino. Associated with every casino T there are the 
smallest rich man’s, poor man’s, and inclusive casinos that include T. 
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Casinos in which all the lotteries in @(1) are generated from a 
single element 6 by dilatation so that every element of @(1) is of the 
form [t6] for some nonnegative t deserve special mention. It is easy 
to construct such one-game casinos that are neither rich man’s nor 
poor man’s casinos. 

We do not know whether every casino function is the casino 
function of a one-game casino, though that seems unlikely to us; the 
minimum of two one-game casino functions is a candidate for a counter- 
example. If counterexamples exist, what is the smaller class? 

The next two chapters are about certain particularly interesting 
one-game casinos. 


8. THE SPECIAL CASINO INEQUALITIES 
DO NOT IMPLY THE GENERAL ONE. 


A continuous function rising from 0 to 1 in [0, 1] can satisfy the 
two special casino inequalities (3.1) and (3.2) and yet fail to be a 
casino function. This fact will not be relied on in future arguments, 
so this section can be skipped or deferred. 

Let U(f) = min (V(f), W(f)), where 


(1) Vif) = 1 — (1 — f)? 
(2) W(f) = 9 + max (3(f — g9), 3(f — 9)). 


Note that V and W, and therefore U, are self-dual in the sense that, 
if (x, y) is on the graph of one of them, so is (9, Z). 

As will be shown, if g is greater than but sufficiently close to 
2-2 then U is not a casino function but does satisfy (3.1) and (3.2). 

Assume once and for all that 2-12 < g < 3/4 (= 9/16)"/?). It 
follows that W(0) (which is 1 — (4g/3)) is positive and that U(f) 
= W(f) in and only in an interval [a,b] with a < g < b. Conse- 
quently, U(a) = V(a) = W(a) = b, and U(b) = V(b) = Wb) = å. 
The graph of U between a and b coincides with that of W. Since 
W(b) — W(a) = a — b = b — a, this piece of graph, when stretched 
horizontally and vertically so as to connect (0, 0) with (1, 1), consists 
of two linear segments of slope 1/3 and 3 and therefore lies uniformly 
below W. Thus U fails the geometric test for a casino function. 

Since U is self-dual, it remains only to check that U(zy) > 
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Figure 1 U(f) = min (V(f), Wf); g = .73. 


U(x)U(y) for all x and y in [0, 1]. If zy is not in [a, b], then U (zy) = 
V (xy) > V(x) V(y) = U(x)U(y); for V is a casino function and never 
less than U. 

There is now no loss in confining the investigation to values of 
x and y with x < y, x in some interval [x1, xe] with zı and zə positive. 
Suppose first that y = 1 — e is very close to 1. Then U(zy) = 
U(x(1 — e)) = U(x)(1 + O(e)) uniformly in [zı, zə] and in the value 
of g yet to be chosen. But U(y) = U(1 — e) = 1 — [1 — (1 — e)? = 
1 — (2e)? + O(e?!2). Therefore, U (xy) > U(x) U(y) for yin (1 — e, 1). 

Finally, suppose z in [x1, z2] and y in [zı, 1 — e]. On this compact 
set, V (xy) — V(x)V(y) => ô for some positive 6. If now g is so chosen 
that V — U < ô, U(zy) > V(zy) — 6 > V(x) V(y) = U(x) U(y), and 
the check is complete. 


5 


RED-AND-BLACK 


1. INTRODUCTION. This chapter is mainly about a very 


special kind of casino, where the only game offered is that of 
red-and-black. The gambler can stake any amount s in his 
possession. He wins back his stake and as much more again 
with probability w, and he loses his stake with probability w, 
0<w<1. Formally, if p is the measure that attaches prob- 
ability w to 1 and # to —1, so that [sp + f] attaches probability 
w to f + s and ù to f — s, then I(f) = {[so +f]: 0<s <f}; 
equivalently, O(f) = {[sp]: 0 < s < J}. 

The possibilities w = 0 and w = 1 could be included, but 
they are trivial and uninteresting. In the terminology of Sec- 
tion 4.4, the casino is easily seen to be superfair, fair, or subfair 
(but not trivial) according as w exceeds, equals, or is exceeded 
by 1/2; correspondingly, in (0, 1), U(f) is 1, f, or positive but 
less than f. Attention will be focused on the subfair possibility 
w < 1/2. 

It is natural to generalize p to a distribution confined to — 1 
and some arbitrary positive value instead of to — 1 and +1, and 
that will be done in the next chapter, but the relative simplicity 
of the theory of red-and-black justifies this separate chapter. 
A parallel special case with w = 1/2 but with the possible gain 
different from the possible loss is also briefly treated in the present 
chapter. 

If w < 1/2, the strong law of large numbers suggests that a 
consistent policy of small bets is a bad strategy. This may stim- 
ulate an interest in large bets. How large? It is illegal for the 
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gambler to bet more than he possesses and plainly unwise for him 
to bet more than just enough to reach his goal if he wins the bet. 
The gambler may, then, be said to be playing boldly if he always 
bets his entire fortune f or enough to reach the goal, whichever is 
least. That is, if f < 1/2, it is bold to stake f, but if 1/2 < f < 1, it 
is bold to stake f. In short, it is bold to stake the miniraum of f and Î, 
or, equivalently, to use the bold gamble 


Amata SaL 
(1) Wire oe B 


The gamble-valued function y determines for each f a stationary 
strategy, called the bold strategy at f and designated by o(f). Since 
y(f) eT(f) for all f, o(f) is available in the red-and-black casino T at f. 

The main objective of this chapter is to prove that the bold 
strategy at f is optimal for w < 1/2. Incidental objectives are to 
establish the identity of U and a function well known in analysis and 
probability theory, to say something about what happens when the 
gambler is required to terminate at the nth move, and to treat briefly 
a kind of casino that might be called dual to red-and-black. 

As a bonus, the study leads to new facts about a prominent family 
of singular distribution functions and about Bernoulli, or binomial, 
processes. 


2. THE UTILITY OF BOLD STRATEGIES 


This section is about the utility u(c(f)) of the family of bold 
strategies as a function of f for O0 <f<1. This function will be 
called Qu, when necessary, but usually simply Q. By definition then, 
Qo) = QF) = ull). 

The bold strategy is almost stagnant. For both 1 — w” and 
1 — w* converge to 1 as n goes to infinity, and the probability of stag- 
nation by the nth gamble is at least as large as one of these two num- 
bers. On this account, it is easy to verify that Q(f) is the (Eudoxus) 
probability of stagnating at 1 under o(f). 

If f < 1/2, the gambler’s first move will leave him at 2f with 
probability w and at 0 with probability w. In the former case, the 
rest of his play is described by o(2/); in the latter case, play stagnates 
with u = 0. This fact and a dual one for f > 1/2 lead, through 
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Theorem 3.2.1, to the conclusion that 


_ | wQ(2f) for f < 1/2, 
(1) Ay) = - + Qf — 1) forf > 1/2. 


There is one and only one bounded function Q on [0, 1] that 
satisfies (1); Q is continuous and strictly increasing; Q(0) = 0, and 
Q(1) = 1. These facts are easy to prove and are explicitly proved 
by de Rham in an interesting paper (1956-1957). Since the prob- 
ability Q(f) is bounded between 0 and 1, Q is characterized by (1) 
and has the properties cited. If w = 1/2, the function f obviously 
solves (1); so Qı(f) = f for f in [0, 1]. 

An interesting interpretation of (1) was pointed out to us by 
W. Forrest Stinespring. Let Q(f) be the probability that the sequence 
of 0’s and 1’s generated by independent tosses with a w-coin (that is, 
one which produces 0 with probability w and 1 with probability w) 
represents a number in the binary notation that does not exceed f. 
If f is at most 1/2, the sequence of tosses can generate a number as 
small as f only if the first binary digit is a 0 and the remaining digits 
represent a number as small as 2f (aside from one possibility of prob- 
ability 0); if f is at least 1/2, an initial 0 ensures success, and success 
can also be had after an initial 1 if and only if the remaining digits 
represent a number as small as 2f — 1. This all means that Q satisfies 
(1) and is therefore the same as Q. This interpretation shows strik- 
ingly that if w ~ 1/2 then Q considered as a monotonic function—more 
specifically, the distribution function of a probability measure—on 
[0, 1] is singular with respect to Lebesgue measure. For, according 
to the strong law of large numbers, the probability measure associated 
with Qu attaches probability 1 to the set of numbers in whose binary 
representation the relative frequency of 0’s is w. Thus, as is well 
known, every Qu is singular with respect to every other. In particular, 
if w = 1/2, then Q, is singular with respect to Q1/2, which corresponds 
to Lebesgue measure. Once it is proved that Q is U for w < 1/2, 
Q will be seen as a casino function which is as irregular, in terms of 
everyday intuition, as a monotonic function can be. 

Interpretation of Q as a distribution function brings out a compu- 
tational formula (which can of course be derived directly from (1)). 


(2) Q((k + 1)2-) = Q(k2-) + wow’, 


86 Red-and-black [Chap. 5 


where k is a nonnegative integer less than 2”, a is the number of 1’s 
in the binary representation of k2-”, and b is n — a. The probability 
argument for (2) is this: To toss a sequence representing a number 
between k2” and (k + 1)2-”, it is sufficient and (almost) necessary 
to begin with the n binary digits that represent k2-”. 

The duality 


(3) Qu(f) = Qz(f) 


can easily be established probabilistically from the definition of Q or 
algebraically by verifying that the right side of (3) also satisfies (1). 

Several points about Q are illustrated by Table 1 for f = k/8, 
k=0,:-- , 8, and for a few other values of f, listed in binary as 
well as in more conventional notation. First, Q is computed by 
application of (1), beginning with k = 0 and 8 and proceeding through 

= 4, k = 2 and 6, and k = 1, 3, 5, and 7. Next, Q is rewritten to 
illustrate the duality (3). Finally, the column of differences illus- 
trates (2). 

The entry for f = 1/3, for example, can be computed from the 
infinite series delivered by repeated application of (2), namely, 
w? + wd + wtw? + - +--+. But the calculation Q(1/3) = wQ(2/3) 
= wlw + 6Q(1/3)] is also of interest. Both types of calculation 
apply to express Q,„(f) as a rational function of w for each rational f. 


Table 1 Selected values of Q.,(f) 


Q(f) 
f 
First form 

0 .000 0 

1/8 .001 ws 

1/4 .010 w? 
3/8 .O11 w? + Dw? 
1/2 .100 w 
5/8 .101 w + ww? 
3/4 .110 w + w 
7/8 .111 w + wow + Dw 

1 1.000 1 

1/3 .0101 -- - w?(1 — wD)! 
2/3 .1010 - -> w(l — wp)! 
27n .00---1 w” 


1-274 .11.---0| wQd+o+--- +a) 
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Figure 1 Values of Qu(f) for w = .2 and .4. 


3. FOR w < 1/2, BOLD PLAY IS OPTIMAL. 


THEOREM 1. The bold strategy at f is optimal for red-and-black 
casinos with w < 1/2. 


Proof: In view of Theorem 2.12.1, it suffices to show that 


(1) Qolf) 2 Wulf + s) + Qulf — $) 


for0 <f—s<f<1landw < 1/2, where it is to be understood that 
Q.(f +s) = lforf+s>1. 

The possibility that f + s > 1 can be set aside. For in view 
of the monotony of Qu, if (1) were to fail for some s > f, it would also 
fail for s = f. Therefore, throughout the rest of the proof let it be 
assumed that s < f. 
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Since Qe is continuous, it suffices to establish (1) for binary 
rational values of f and s, that is, for numbers of the form k2-* with 
k and n nonnegative integers and k < 2”. A number of this form 
will be said to be of order at most n. It will frequently be convenient 
to consider that all other numbers in the unit interval have infinite 
order. 

At least one of the transformations f— 2f or f — 2f — 1 carries 
f back into [0,1]; both do only if f = 1/2. These transformations 
carry numbers of order n into numbers of order n — 1, except that 
the numbers of order 0, that is, 0 and 1, are left invariant. 

It is trivial to verify (1) if f and s are of order 0 or of order 1. 
Next, suppose that (1) has been established for all binary rationals 
f and s of order at most n, and study an f and an s of order at most 
n + 1. There are four cases to be considered, and it is helpful to 
rewrite (1) as 


(2) Q(f) — wQ(f + s) — wWQ(f — s) = 0. 


Case 1, f + s < 1/2. The first functional equation of (2.1) and 
the inductive hypothesis justify the calculation: Q(f) — wQ(f + s) — 
DCF — s) = wQ) — wf + 2s) — WQ(2f — 2s)] = 0. 

Case 2, f — s > 1/2. The proof is just as in Case 1, except that 
the second functional equation of (2.1) is used instead of the first. 

Case 3,f — s < f < 1/2 < f +s. Calculate thus: 


(3) Q(f) — wA + s) — DR — s) 


wQ(2f) — wlw + DRF + 2s — 1)] — wHQ(2f — 2s) 
wiQ(2f) — w — QF + 2s — 1) — Rf — 2s)]. 


Now f is necessarily greater than 1/4, for otherwise s < 1/4 and f + s 
< 1/2. Therefore 2f > 1/2, and the sequence of equalities (3) can 
be continued thus: 


(4) wlw + wQ(4f — 1) — w — WQ(2F + 2s — 1) — WO — 2s)] 
wwlQ(4f — 1) — Q(2f + 2s — 1) — Q(2f — 2s)] 


= w[Q(2f — 1/2) — wQ(2f + 2s — 1) — wQ(2f — 2s)]. 
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Since w < w, this last expression is greater than or equal to both 
Df — 1/2) — wQ(2f + 2s — 1) — BQ(2f — 2s)] 

and 
wl Q(2f — 1/2) — wQ(2f + 2s — 1) — wQ(2f — 2s)]. 


It is strictly greater than both unless w = 1/2 or f — s = 0. By the 
inductive assumption, the first or the second of these expressions is 
nonnegative, according as 2f + 2s — 1 > 2f — 1/2 or 2f — 2s > 
2f — 1/2, that is, s > 1/4 or s < 1/4. 

Case 4, f— s < 1/2 <f <f+s. The proof for this case is 
similar to that of the preceding one. @ 


Though (1) is but a very special case of the casino inequality 
(4.2.1), by implying that Q is the U of red-and-black casinos for 
w < 1/2, it implies the whole casino inequality. This has certain 
consequences for the binomial process corresponding to independent 
tosses with a w-coin. For example, the special casino inequality 
Q(fg) > Q(f)Q(g) implies that the conditional probability of generat- 
ing a binary number less than fg, given that the number is less than g, 
is at least the unconditional probability that such a number is less 
than f. 

In general, facts of this chapter and the next can be interpreted 
as new facts about the Bernoulli process and about the functions Qu, 
which have an independent analytic interest as singular distribution 
functions. For literature on the Q,, see (de Rham 1956-1957). 

The following instance of strict inequality in (2) will soon be used. 


THEOREM 2. Q.(f) > wQ.(f +s) + wQ.(f —s) fF O<f—s< 
1/2<ft+s<landw < 1/2. 


Proof: There are two cases corresponding to Cases 3 and 4 in the 
proof of Theorem 1. Assume first that f < 1/2. The calculation 
for Case 3 of Theorem 1 shows that Q(f) — wQ(f + s) — wQ(f — s) 
is strictly greater than a quantity which, in view of Theorem 1, is now 
known to be nonnegative. A dual argument applies for f > 1/2. ¢ẹ 
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4. OTHER OPTIMAL STRATEGIES FOR w< 1/2 


A stake s for the fortune f is conserving if the lottery 0 that wins s 
with probability w and loses s with probability w is such that [f + 6] 
conserves U at f, that is, if [f + 0]Q = Q(f). Thus the stake s is 
conserving at f if and only if 


(1) QC) = WCG + s) + “Qf — $), 


which clearly requires that f +s <lorf—s>1. 

What are the conserving stakes available at fin (0, 1), that is, the 
s < min (f, f) which satisfy (1)? The functional equations (2.1) imply 
that, for f < 1/2, s =f is conserving, whereas, for 1/2 <f <1, 
s =f is conserving. Let S.i(f) =f for f < 1/2 and Si(f) =f for 
1/2 < f < 1, that is, Si(f) = min (f,f). Then S,(f) is a conserving 
stake for the fortune f. The following observation leads to the dis- 
covery of a sequence of conserving stakes. Suppose that a gambler 
with a fortune f < 1/2 adopts a strategy o that first maximizes the 
probability of reaching 1/2 before bankrupting the gambler, and then, 
if he has nad the good fortune to reach 1/2, goes on to maximize the 
probability of reaching 1. The probability of reaching 1/2 from f 
in any casino with a casino function U is at least U(2f). Thus the 
probability of reaching 1 under ø is at least 


U(1/2)U(2f) = Q/A) = wW) = Qf) = U). 


Therefore, o is itself an optimal strategy. 

Since red-and-black is an inclusive casino, contraction by the 
factor 1/2 of an optimal strategy at 2f is optimal for reaching the 
fortune 1/2 from f. Therefore, So(f) = $Si(2/) is a conserving stake 
for f when the space of fortunes is [0, 1/2] and the goal is 1/2. But as 
the preceding discussion shows, it is therefore also a conserving stake 
for the original red-and-black casino. Moreover, if 2f > 1/2, S2(f) 
is unequal to S,(f). Thus bold strategies are not the only optimal ones. 

Suppose next that a gambler with a fortune f, 1/2 <f <1, 
adopts a strategy o that first maximizes the probability of attaining 1 
before the fortune becomes as low as 1/2, and then, if the fortune 
drops to 1/2, goes on to maximize the probability of reaching 1 by 
adopting the bold strategy. The probability of reaching 1 under such 
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a strategy is U(2f — 1) + wU(2f — 1) = Qf — 1) + wQ(2f — 1) = 
w+ wQ(2f — 1) = Q(f) = U(f). Therefore, this strategy is also opti- 
mal. Again, since Sı is a conserving-stake-valued function for red- 
and-black, S2(f) = $Si(2f — 1) is conserving for [1/2, 1] as the space 
of fortunes with 1 as the goal. Therefore, for each f in the unit 
interval, S2(f) is a conserving stake for the original red-and-black 
casino. 

Define S,4:1 by induction: Snrsi(f) = $S,(2f) or $S8,(2f — 1) 
according as f < 1/2 or f >1/2. The argument already given shows 
inductively that, for each n and f, S,(f) is a conserving stake. 

It is easy to verify that S,+1(f) is the distance between f and the 
closest nth-order binary not necessarily different from f. Therefore 
S,(f) is a monotone decreasing sequence of nonnegative functions 
that converges to0. For any f other than a binary rational, S,(f) > 0 
for all n. Therefore, for any such f there are arbitrarily small, but 
positive, conserving stakes, though naive intuition about the law of 
large numbers might erroneously suggest that small stakes are to be 
avoided. It is convenient to let S,(f) = 0; for 0 is a trivial conserving 
stake. 

There are in fact no conserving stakes other than S,(f) and 0. 
Suppose otherwise. Then equality holds in (1) for some f and some 
positive s other than any S,(f). Choose such a pair f, s for which 
s is more than half as large as the supremum of all such s. Then f — s 
and f + s are strictly separated by 1/2. Why? If, for example, 
f +s < 1/2, an application of the first of the functional equations (2.1) 
implies that equality holds in (1) for 2f and 2s. Furthermore, 2s 
is not S,(2f) for any n, for otherwise s = 32s = Sn4i(f), contrary 
to the assumption that s = Srai(f). A similar argument is applicable 
if 1/2 < f — s;sof — s < 1/2 <f + s. Furthermore, f — sis not 0, 
nor is f + s equal to 1, for otherwise s = Si(f). But for such f and s, 
as Theorem 3.2 states, equality does not hold in (1). Therefore s is a 
conserving stake for f if and only if s = S,(f) for some n. This is 
recorded in the next theorem. 


THEOREM 1. For0 <f-—s<f<landw < 1/2, 


(2) Qolf) > Wf + $) + Relf — 8). 


Moreover, for 0 < w < 1/2, equality holds in (2) if and only if 
s = S,(f) for some n (including n = œ). 
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Now that all conserving stakes and hence all conserving gambles 
have been determined, it is easy to characterize all optimal strategies. 


THEOREM 2. A strategy o, available at f in (0,1) in a subfair 
red-and-black casino, is optimal if and only if, immediately following 
each of the at most denumerably many partial histories of positive 
o-probability (including the vacuous one), none but conserving stakes 
are used, and stagnation does not occur after any such partial history 
except at O and 1. 


Proof: Theorems 3.4.1 and 3.5.3 apply. The main point to 
check is that, if o satisfies the hypotheses, then the probability that 
fm is a binary rational converges to 1 as m approaches œ; once fm is a 
binary rational, each succeeding gamble reduces the order with cer- 
tainty, until order 0 is attained. ¢ 


(The situation for fair red-and-black casinos is clearly quite differ- 
ent from that described in Theorem 2 for subfair ones.) 

A stationary family of strategies ¢ is tantamount to a stake- 
valued function s, with s(f) < f. The characterization of optimal 
strategies in Theorem 2 implies that s corresponds to astationary family 
of optimal strategies if and only if, for every f in (0, 1), s(f) is a con- 
serving stake for f other than the trivial stake 0, and for every f > 1, 
sf) <f-1. 


COROLLARY 1. A stake-valued function s determines a stationary 
family of optimal strategies if and only if, for every f in (0, 1), there 
is a nonnegative integer n = n(f) less than the order of f such that s(f) 
is the distance between f and the closest nth-order binary rational (and 
s(f) <f — 1 for f > 1). 


There clearly exist wildly irregular (for example, non-Lebesgue- 
measurable), conserving-stake-valued functions as well as many that 
are only mildly irregular. However, only the bold one (corresponding 
to n(f) = 0) is continuous, as is easily seen. 


5. LIMITED PLAYING TIME 


As Aryeh Dvoretzky pointed out to us, even under the require- 
ment that play be limited to m moves, bold play is still optimal. He 
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pointed out also that this is not true of the somewhat more general 
casinos to be studied in the next chapter. Here is his argument for 
the red-and-black casino. 

Let Qn(f) be the probability of winning in m moves with the 
bold strategy beginning at f. The Qm satisfy functional equations 
like (2.1): 

Qnii(sf) = wQn(f), 


(1) nii (: in = w + BQn(f) 


2 
forO <f <1. 
The proof given for the inequality (3.1) also shows that 


(2) Qnal f) 2 WOnl(f + 8) + WOn(f — 8) 


for binary rationals fandsifO <f—s<f<1l. 

That (2) holds also when f and s are not binaries may be seen as 
follows. Let fm denote for the moment the largest binary rational of 
order m that does not exceed f. Then 


E be for f <4, 
BAHAS- Im)  forf># 


This fact and (1) imply by induction that 
(4) Qn(f) = Qn( fm). 


Finally, compute thus, 


(5) Qmti(f) = Qmti(Fm+1) 
> Qmsila(f + 8)m + 3(f — 8)m) 
> WOmn((f + 8)m) + Dn (f — S)m) 
= wQn(f + $) + WQn(f — 8). 


The first inequality depends on the arithmetic inequality, 
(6) Sm+i = 3(f + S)m F a(f B S) my 


which is true simply because the right side of (6) is a binary of order 
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m + 1 not larger than f. Thus (2) holds without the restriction to 
binaries. But equality holds in (2) for the bold value of s; so 


(7) Qmail) = sup {wQn(f + s) + BOn(f — s)}. 


Let Um(f) be the optimal probability of winning in m moves 
beginning at f. Then the sequence Um satisfies (7) in the role of Qm. 
Since U, = Qu, it follows by induction that Qm = Um for all m, and 
bold strategies are seen to be optimal for limited playing time. Of 
course this immediately implies that Q, = U.. This and Theorem 
4.5.1 provide a variant of the proof of Theorem 3.1 given earlier 
that Q = U. 


6. THE TAXED COIN 


Consider a casino in which the only game available is to bet 
on the outcome of a fair coin. A fixed fraction of the stake is collected 
as tax (or entrance fee); the remainder is paid back twice over if and 
only if the coin falls heads. It is convenient to denote the ratio of the 
possible gain to the stake by 7/r, where0 <##<r<1. ThusI(f) = 
{soe + f]: s < f}, where p’{—1} = p’{7/r} = 1/2. 

Once more the bold strategy—that for which s(f) is the minimum 
of f and fr/7 for f in (0, 1), and s(f) = 0 elsewhere, so that every bet 
has a chance to be decisive—is interesting. The utility of the bold 
strategy satisfies an equation closely analogous to (2.1). 


=k (2) forf <r, 
2 r 
(1) R(f) = 
+5 2(4) forf >r, 
2 2 f 


which is tantamount to the pair of equations, 


2R(rf) forO <f<1, 


(2) R(f) = 
2R +F — 1 for0<f<1. 


Equation (1) has at most one bounded solution, because the discrep- 
ancy between any pair of solutions is doubled by passing from f to 
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f/r or to (f — r)/7, whichever lies in [0, 1]. But if Q, is the function 
defined by (2.1), then clearly Q7? satisfies (1) so R,(f) = Q71(f). 

The fundamental inequality for Q, with r > 1/2 is obtained by 
applying the duality (2.3) to the inequality (3.1). 


(3) Q-(f) < rQ,F + $) + 70,9 — $) 
forO<f—s<ft+s<land1l>r2 1/2. 

This is equivalent to 
(4) R,(g) 2 4R,.(f + tF) + 4B — tr) 


forO <g—ir<g <1. 

Therefore the bold strategy is optimal for this casino, and R is its 
casino function. It is also easy to describe all optimal strategies and 
to show that bold strategies are optimal even for limited playing time. 

To do the latter, prove that 


(5) Ralf) = Rf) m; 


where R,.(f) is the probability of success in m moves with the bold 
strategy beginning at f, and R(f)» is the largest binary rational of 
order m that does not exceed R(f). Since any further details would 
bore you and us, we move on to the next chapter and a more general 
type of casino. 


6 
PRIMITIVE CASINOS 


1. INTRODUCTION. This chapter is about a significant gener- 
alization of the red-and-black casinos, which we shall call primi- 
tive casinos because information about them and their casino 
functions has important implications for all casinos and casino 
functions (Section 7). 

The wording and organization of this chapter take advantage 
of many parallels with Chapter 5, which this chapter generalizes. 
It is possible to cover swiftly here much that will be easy in the 
light of Chapter 5 and also to give new insights into that chapter. 

In a primitive casino, once again, all the gambler can do is 
to stake an amount s, losing it with probability # and winning 
with probability w, 0 < w < 1. The difference is that now his 
fortune is not necessarily increased by s, when he wins a bet, but 
by some fixed multiple of s, which it is convenient to write fs/r. 
Formally, if p is now the measure that attaches w to 7/r and w 
to —1 for some r in (0, 1), then ['(f) = {[sop + f]: 0 < s <f}. 
The possibilities w = 0 or 1, or r = 0 or 1, would not be inter- 
esting; r = 1/2 is red-and-black; w = 1/2 is the taxed coin, also 
treated in Chapter 5. A primitive casino is easily seen to be 
superfair, fair, or subfair according as w > r, w =r, or w <7; 
this is one advantage of the notation in terms of r. 

To play boldly at f in (0, 1) is, as before, to stake as much 
as possible without risk of overshooting the goal, that 1s, to make 
the largest bets that are both legal and reasonable. The bold 
gamble at f in the primitive casino T is 
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| min @ 2), +z] for0 < f <1, 


(1) y(f) = | 
ôC) for f > 1, 


and the stationary family of strategies o determined by y are the 
bold strategies. 

The main objective of this chapter is to prove that o(f) is optimal 
for w <r. Other objectives, in analogy with Chapter 5, are to 
determine U(f), to find all optimal strategies, and to say something 
surprising about what happens when the gambler is required to 
terminate at the nth move. There are still other objectives and 
by-products, without analogy in Chapter 5, that it would not be 
practical to indicate in advance. More new inequalities for binomial 
processes are a bonus. 


2. THE UTILITY OF BOLD STRATEGIES 


Let Su., or S for short, be the utility of the bold strategies as a 
function of f. 


The derivation of (5.2.1) is easily generalized to show that 


ws ($ forf <r, 


w + as (=) forf >r. 


(1) S(f) = 


This is obviously equivalent to the more handsome equations, 


SO = s(2) forf <r, 
W r 
(2) 
soe s(t) forf >r 
w F a 


and to the useful 
(3) Sf) = wS fF) Sir+7f)=wt+wS(f) forO0<f<l. 


These pairs of equations are as obviously equivalent to the duality- 
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revealing pair, 


(4) wS(f) = S(rf) BSG) = SFP). 


One and only one bounded function of f on [0, 1] satisfies (1). 
This solution is continuous and strictly increasing; S(0) = 0, and 
S(1) = 1. These facts could apparently be proved by extending the 
method of de Rham (1956-1957), but it is more convenient here to 
infer them mainly from the case treated by him and already used in 
Chapter 5. 

The uniqueness is easy to prove directly, as it was for the taxed 
coin. For the difference AS between two solutions of (1) satisfies 


(5) AS (‘) SAOU saree: 
r w 

(6) AS =) =S) tory >t, 
T w 


so that AS must be identically 0 or unbounded. 


In the notation of Chapter 5, Q..(Q;*(f)) is easily seen to satisfy 
(1); so 


(7) Swr(f) = QoQ (S). 


Therefore S does have the continuity and monotony anticipated. 
The construction (7) will be useful later, especially when expressed 
as a pair of parametric equations, 


(8) S(a) = Qula) fla) = Qa) forO0<a<l. 


In view of (8), the interpretation of Q.(f) as the probability 
of tossing a number as small as f with a w-coin has a counterpart here, 
but a clumsy one. Namely, S,,,,-(f) is the probability that a w-coin 
will produce a number as small as that number a for which an r-coin 
produces numbers as small as a with probability f. 

It is easy to verify these relations among the S,,-: 


(9) Solf) = Spat) = SaF) = Sra). 
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In the language of Section 4.6, Sw, and Sz are a pair of dual 
functions. Unless w = r, in which case S(f) = f, Sy, is singular. To 
see this, note that, according to the strong law of large numbers, 
Qu and Q, are mutually singular, and then apply the following simple 
theorem. 


THEOREM 1. If Q and Q* are continuous distribution functions, 
and Q is strictly increasing, then Q and Q* are mutually singular 
if and only if Q*Q-! is singular with respect to Lebesgue measure. 


Proof: The following four assertions are plainly equivalent. 

(a) Q and Q* are mutually singular. 

(b) There is a set A for which Q*(A) has Lebesgue measure 0 
and Q(A) has Lebesgue measure 1. 


Sw r(f)— 


Figuro 1 Values of S.s, .7(f) and S.c, .7(f). 
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(c) There is a set B of Lebesgue measure 0 for which Q*Q-!(B) 
has Lebesgue measure 1. 


(d) Q*Q-! is singular with respect to Lebesgue measure. @ 


Except in the trivial cases, w = w’ and r =r’ or w =r and 
w’ = r’, we suspect that Su, 1s singular with respect to Sw,. Theorem 
1 makes this clear for r = r’. And Theorem 8.2 says that the func- 
tions are not identical except in the trivial cases. 


3. BOLD PLAY IS OPTIMAL FOR SUBFAIR 
PRIMITIVE CASINOS. 


Parallel with Section 5.3, it is important to prove that 
(1) T(f,9) = SQf + 7g) — wS(f) — wS(g) = 0 


for f > g and (as always in this section) w <r. This will show 
that S = U, that bold strategies are optimal, and that S satisfies 
the whole casino inequality. The case w = r, when S is fair, is 
trivial as before. 

Our only proof of (1) is much more difficult and roundabout than 
that of the analogous (5.3.1). 

The problem will be transformed several times before (1) is 
finally proved. First of all, attention is shifted from T to a new 
function T”. 


S(f +g) — S(f) — Sg) forf+g<1, 


(2) T'(f,9) = | 
S(f +g — 1) — S(f)— S(g) +1 forf +g 21. 
If T(f,g) were ever negative with f > g, then, as will be shown, 
I’(f’, g’) would also be negative for some f’, g’ in [0, 1]. (The converse 
is also interesting to know and easy to prove but of no logical impor- 
tance for the proof of (1).) The program now is: (a) to confirm that 
violation of (1) implies a negative value of T’; and (b) to show that 
negative values of T’ are impossible, or, equivalently, that S is super- 
additive and S(f) is subadditive in f. 
If there is any solution of T(f,g) < 0 with f > g, then there 
is one with f >r > g. Consider, in fact, any solution with f — g 
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nearly as large as possible. Since T(f,f) =0,f—g>0. Iff<r 
or g È> r, then application of (2.1) leads to a new solution substan- 
tially more widely separated, which is impossible. 

Suppose then that (1) is violated by f, g with f > r > g, and cal- 
culate thus: 


(3) wS(f) = w? + wis ( z r 
(4) wS(g) = wiS (2) 
(5) Sirf + #9) = wS (=) 

Bere en for rf +79 <r, 

T 
= w + was (E +2) 
=w + as (ee u r) 
f 


for rf + řg 2r. 


w + was (E +2- 1) 


According to (3), (4), and (5), if f >r > g and T(f,g) < 0, then T” 
is negative at the pair of arguments (f — r)/7 and g/r. 

The problem now is to show that T’(f, g) > 0 for all f, g in [0, 1]. 
This will entail three or more reformulations of the problem, depend- 
ing on how you count them. 

First, what does it mean in terms of Q, and Q, to say that T” > 0? 
If, for example, f +g < 1, let a, b, c be such that Q,(a) =f +9, 
Q,(b) = f, Q.(c) = g. Then, introducing a new function D, 


(6) D(r) = Q,(a) = Q,(6) Peg Q,(c) = 0, 


and 


(7) T(J, g) = D(w) = Qw(a) = Qw(d) = Q.(c) > 0. 
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So it has to be proved that no negative value of D(w) = D(w; a, b, c) 
precedes any zero of D(w) for any a, b, c in [0, 1]. 

The case f + g > 1, on the other hand, requires it to be proved 
that D(w) + 1 also has no negative values prior to any of its zeros. 
But since Q.(a) = 1 — Q3(d), according to (5.2.3) or the more general 
(2.9), D(w;a,b,c) +1 = —D(w;4,6,¢). Thus the condition on 
D(w) + 1 amounts to requiring that no positive value of D(w) 
succeeds any of its zeros. 

All in all, what must be shown is that, for w in (0, 1), all the 
zeros of D(w) are preceded by only nonnegative, and succeeded by 
only nonpositive, values. 

(Though the fact does not enter logically into the present argu- 
ment, it may be clarifying to point out here that Q, and therefore also 
D, is analytic in w; so D must actually have at most one zero in (0, 1) 
if it is not identically 0. Indeed, in view of (5.2.2), Q,(a) is expres- 
sible as a series, terminating or infinite, of the form 2 w*w*™, where 
a(n) is a nondecreasing sequence of positive integers. The terms 
of the series are dominated by a” in the complex domain 


{w: |w| < a, |1 — w| < a}, 


so the series converges uniformly to an analytic function in each such 
domain with a < 1. Incidentally, Q.(1/3) is singular just at the 
two complex numbers for which |w| = |1 — w| = 1, according to 
Table 5.2.1.) 

It will be enough to show merely for binary rationals a, b, c 
that, as a function of w, D has no positive value after, or negative 
value before, any of its zeros. To see that this will suffice, suppose, 
for example, that, for some real numbers a, bı, ci, the function D, 
had a negative value before one of its zeros, where 


D (w) = D(w; Qi, bi, cı). 


Thus, for some w, and we with wı < we, Di(wi) < 0 = D,(wə). 
Choose binary rationals a, b, c, for which D(w,) < 0 and D(we) > 0. 
For example, choose a, b, c, close, respectively, to a, 61, cı with a > a1, 
b <bi,andc < cı. Then, for some w; with w; < w; < we, D(w:) = 0. 
Hence a negative value of D would precede one of its zeros. It thus 
suffices to restrict attention to binary rationals, as asserted. This 
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program for binary rationals involves a digression about Q.(a) for 
binary rational a, that is, a of the form x2~-* with z and n nonnegative 
integers and x < 2”. 

If x is a nonnegative integer, let k(x) be the number of 1’s in the 
binary expansion of x; equivalently, k(0) = 0, k(2z) = k(x), and 
k(2x + 1) = k(x) + 1. 

Let N(j; x) be, for all integers 7 (including negative ones), the 
number of nonnegative integers y for which y < x and k(y) =j. 
Equivalently, N(j;0) = 0 for all j, and 


(8) N(j; a + 1) = N(J; x) + (9, k(z)), 


where ô = 1 or 0 according as k(x) is or is not J. 
The relevance of N is that if a = x2-” then 


(9) Qula) = w È NG; 2) (2): 


a relation easily proved by means of (5.2.2). (Incidentally, N is 
easily seen to be characterized by (9).) 
In view of the definition of N(j7; x), 


(10) N(j; 2x) = N(j;z) + NG — 1;2); 
(11) N(j; 2a +1) = N(j;x +1) + NG — 152). 

Return now to the study of D(w;a, b,c) with a, b, c binary 
rationals but with the new notations: a = x2-", b = y2-", c = 227”, 
v= w/w > 0. 

(12) D'(v; x, y, 2) = w"D(w; a, b, c) 


> ING: x) — N(J; y) — NG; z)’ 
= ) M(j; z, y, 20, 


In these terms, the problem is to show that the polynomial D’(v) 
is never positive before, or negative after, a zero, where it is to be 
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understood that D’(v) is considered meaningful only for strictly posi- 
tive v. More will actually be shown, namely, that the coefficients 
M(j) of D’ are Cartesian, that is, if M(j) < 0 < M(j’), thenj < 7’. 
This is more than is required; for if M is Cartesian, then D’ either 
has the same sign for all positive v, or is identically 0, or has a single 
(positive) zero preceded by negative and followed by positive values, 
according to ‘‘Descartes’ rule of signs”. (See, for example, (Dickson 
1939, p. 77) or, for historical sidelights (Descartes 1925, p. 160).) 

The proof that M is Cartesian will be given by induction on 
x, y, z according to the following two-step program: 

Step 1. M is Cartesian for zx, y, 2 < 2 = 2°+ 1. 

Step 2. If M is Cartesian for all eight triples of the form z + &, 
y+n,2+¢, where £, n, ¢ = Oor 1, then M is also Cartesian for the 
eight triples 2x + £, 2y + n, 22 + t. 

Proof of these two steps will effect the induction, thus: According 
to Step 2, if M is Cartesian for all z, y, z < 2” + 1, then M is also 
Cartesian for x, y, z < 27+! + 1; and Step 1 starts the induction with 
n = 0. 

Proof of Step 1: The following general facts go a long way toward 
proving that M is Cartesian in the 27 instances of 0 < z, y, z < 2. 
M(x, y,2) = M(z,2, y). M(a, y,0) = M(z,0, y) and never changes 
sign with changes inj, because N (7; x) is nondecreasing in x. M (x,y,z) 
is nonpositive if x < y or x < z, for the same reason. 

There remains only to study the instances of 2>2>y2>2z 
> 0, and of these there exists but one, z = 2 and y = z = 1. But 
M(j;2,1,1) = NG; 2) — 2N(j; 1), which is O forj < 0,1 — 2 = —1 
for j = 0, 1 — 0 = 1 for 7 = 1, and is 0 — 0 = 0 for 7 > 1; so this 
sequence is Cartesian, and Step 1 is proved. 

Proof of Step 2: Introducing abbreviations and exploiting (10) 
and (11), what has to be proved here is that M + 6 + M* is Cartesian 
if all eight instances of M + ô are Cartesian, where M = M(j) = 
M(j;2,y,2), 6 = S(j) = £5(7, k(z)) — nòli, k(y)) — tl, k(z)), and 
M* = M*(j) = M(j — 1). 

Let j be called a plus, a minus, or a zero of a sequence according 
as the sequence is positive, negative, or 0 at 7. To illustrate, a 
sequence is Cartesian if and only if none of its minuses exceeds any 
of its pluses. 

If all eight instances of M + 6 are Cartesian, then, as will be 
shown, no minus of M + 6 exceeds any plus of M, and every plus of 
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M + 6 exceeds every minus of M. (Note the slight asymmetry of 
the two parts of this statement. Neither symmetric form is of inter- 
est to us; one of them is too weak, and the other is false.) 

First, suppose that M + 6 is negative at j and M is positive at j’ 
with j > 7’; then k(y) or k(z) or both must be j. Consider the instance 
of M + ô that arises with £ = 0, and y and ¢ = 1 or O according 
as the corresponding k(y) or k(z) is or is not j. This instance of M + ô 
is identical with M except at 7, where it is negative. It therefore is 
positive at 7’ and negative at 7; so it is not Cartesian, contrary to 
hypothesis. By practically the same argument, a plus of M+ ô 
cannot be exceeded by a minus of M either, nor can it ever equal a 
minus of M, since M (j) is an integer and 6(7) < 1. 

Obviously M* resembles M + ô in that no minus of M* exceeds 
any plus of M and every plus of M* exceeds every minus of M, because 
M is Cartesian. Therefore M + -+ M* has this same property. 

Now suppose that M + ô + M* is not Cartesian, but is negative 
at 7 and positive at 7’ with7 > 7’. In view of the preceding paragraph, 
j exceeds no plus of M and 7’ exceeds every minus of M. Since 
J’! <7,j' is exceeded by every plus of M, and M(j7’ — 1) = M*(j7’) < 0; 
so M + ô is positive at 7’. Since 7’ < j, 7 exceeds every minus of M 
by more than 1, and M(j — 1) = M*(j) > 0; so M + ô is negative 
at j. This, however, contradicts the hypothesis that M+ 6 is 
Cartesian. 

The induction is complete; M(x, y, z) is Cartesian in 7 for all 
x, y, 2; and the aims of the section are attained. 

The conclusion that bold play is optimal for a casino generated 
by a lottery p plainly applies also to a casino generated by a mixture 
of p with the trivial lottery 5(0). Possibly it applies to any subfair 
casino generated by a mixture of two lotteries, one of which has no 
chance for positive gain and the other of which is 6(x) for some positive 
x. Nevertheless, boldly we conjecture that essentially the only one- 
game subfair casinos for which bold play is optimal are the primitive 
casinos. 


4. DIGRESSION ABOUT N 


Since the study of primitive casinos has led to the function N 
and a curious inequality concerning it, some may be interested in 
studying N and the inequality a little further with us, although we 
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ourselves have done scarcely more than raise some natural questions. 
This section can freely be postponed or omitted. 

Since the fact that N(a) — N(b) — N(c) is Cartesian seems to be 
just about needed to prove the inequality (3.1), and since that inequal- 
ity actually implies the much more general casino inequality (4.2.1), 
maybe the full casino inequality corresponds to the Cartesianness of a 
sequence more general than M. Specifically, the full casino inequality 
says that, for b > c, 


(1) Cw) = Oy (a) —- QW (d) Qu (b) me Qo (d) Qu (c) 


has no negative values prior to a zero; so maybe the coefficients 
of the polynomial (1 + v)**”C((1 + v)—), for each a, b, c of order m 
and d of order n, are Cartesian. We do not pursue the question now, 
but mention it in case N proves to be mathematically interesting apart 
from gambles. 

Again, it is natural to suspect that all differences of the form 


m 


(2) > NG; 2) — 5 NCJ; ye) 
s=] 


r=1 


are Cartesian-like in having at most a limited number, say A(m, n), 
of changes in sign. We suspect that A(m, n) is min (m, n) if m =n 
and is m — 1 if m = n. Examples attaining these bounds are easily 
constructed on the basis of N (j; 1) = 6(7, 0), N(j; 2%) — N(j; 2” — 1) 
= ô(j, n). The bounds have already been shown, more or less explic- 
itly, to be correct for m = 0 and 1; for the proof that M is Cartesian 
does not really use the fact that n = 2. 

The function N(j;xz) is conveniently expressible in terms of 
binomial coefficients and the binary expansion for z, 


k(x) —-1 
(3) z= ) grein, 


where p(r; x) is strictly decreasing in r. Equation (3), of course, 
defines a one-to-one correspondence between positive integers x and 
strictly decreasing sequences of nonnegative integers p. According 
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to the definition of N or according to (3.10) and (3.11), 


(a) wGia) = 5 (PO) 
= NYG; P), 


where an established notation for binomial coefficients and an evident 
abbreviation have been introduced. Thus the Cartesianness of N(a) 
— N(b) — N(c) is seen as an inequality pertaining to certain sums of 
binomial coefficients. The following special case is interesting in that 
it relates two, not three, sums. 


yes a E 


is Cartesian in j for each k > 0, for (5) can be seen as an instance of 
M(j + k) by adding 


© A gees 


to (5) and then subtracting it. 

Of course, N(x) is never the same function of j for two different z; 
indeed, 2 N(j; x) = x. Therefore N’(p) is never the same function 
of j for two different sequences p. For a fixed 7, however, it is quite 
possible to have the same value of N (or N’) for many z (or p). For 
each j except 7 = 0, N(j; x) is nondecreasing and assumes all nonnega- 
tive integers as values. It has the value 0 from xz = 0 through 
x = 2i — 1. Forn>0, N(j;z) = n from just beyond the nth zx for 
which k(x) = j through the (n + 1)st. This latter is also character- 
ized as the only solution z of N(j; x) = n for which k(x) = j. Clearly 
now, for each positive j and nonnegative n, there is a unique sequence 
of nonnegative integers p(0) > p(1) > - - - > p(j — 1) such that 


(7) ae >) 1 tant he Ps P), 


Kruskal (1963) and Lehmer (1964) also noticed this manner of “‘writ- 
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ing” n in terms of p(0), - - - , p(j7 — 1) and use it in certain combina- 
torial problems. 

Certain other studies of combinatorial problems in the literature, 
for example (Riley and Hatcher 1958, 1959), bear some, though per- 
haps only superficial, resemblance to our study. 


5. OTHER OPTIMAL STRATEGIES FOR w <r 


This section determines all optimal strategies for subfair primitive 
casinos. 


THEOREM 1. The S of a subfair primitive casino satisfies 


(1) S(f +g) = S(f) + Sg) 
and 
(2) S+ 9) < Sf) + Sa) 


for O< f<f+g<1. The inequalities are strict except in the 
trivial cases f = 0, g = 0, w = 0, orr = 1. 


Proof: The superadditivity of S and the subadditivity of S(f) 
are mere paraphrases of the nonnegativity of T’(f, g) in Section 3. 
If equality holds in (1), then equality holds in (8.6) and in (3.7). 
Since w < r, D is identically 0 in (0, 1) according to the parenthetical 
remark below (3.7), and D(1) is 0 because of the easily verified conti- 
nuity of Din [0,1]. Therefore either b or c is 0, and so for gis0. A 
parallel argument handles equality in (2). 


COROLLARY 1. S(rf +79) > wS(f) + Sg) forO<g<r<f<l 
and0 <w<rx<l. 


As f ranges over the binary rationals of order n, Q,(f) ranges 
over the r-ary numbers of order n. Any two successive r-ary numbers 
of order n are the endpoints of one of the 2” r-ary intervals of order n. 

The next result, which in effect characterizes all conserving stakes 
for subfair primitive casinos, is easy to establish by arguments parallel 
to those for Theorem 5.2. 
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THEOREM 2. S(rf + 79) > wS(f) + wS(g) forf > gand0 <w < 
r<l. Forl >f>gand0 <w <r <1, the inequality is strict unless 
f or g is an endpoint of an r-ary interval that contains rf + 7g. 


Now that all conserving stakes have been determined, it is easy 
to characterize all optimal strategies. Indeed, Theorem 5.4.2 holds 
for subfair primitive casinos, and a parallel to Corollary 5.4.1 charac- 
terizes all stationary families of optimal strategies. 


6. LIMITED PLAYING TIME 


Aryeh Dvoretzky discovered and showed us that truncating play 
at the mth move reveals a difference between the general primitive 
casino and the special types studied in the last chapter: bold strategy 
is no longer necessarily optimal for limited playing time. We do not 
attempt a systematic exploration of the situation but simply present 
two examples by Dvoretzky, with his permission, and point out as 
well as we can where the demonstration of the efficacy of bold strate- 
gies for red-and-black and for the taxed coin does not generalize to all 
primitive casinos. 


Example 1. Suppose w <r < 1/2, and consider what can be done 
in three moves beginning at any f in the half-open interval 
[r — rr(F — r),r). The bold strategy wins in three moves if and 
only if the first move and at least one of the next two moves are 
successful. The probability of attaining the goal in three moves 
under the bold strategy is therefore w(w + wi). 

But a better strategy is to stake only enough on the first 
move to reach the fortune r + rr if successful, and to play the 
remaining two moves boldly. This modification does no harm; 
the gambler still attains the goal in all those cases in which he 
attained it under the bold strategy. In addition, even if the 
gambler’s first move is unsuccessful, he will now find himself with 
f— [r +77) — flr/F =[f-—-r?214+7)/F > r?, a fortune from 
which he will attain the goal if his two remaining bold moves are 
successful. This modification therefore adds ww? to the prob- 
ability of attaining the goal. 


Example 2. Thisexamplewithr > 1/2 is moredelicate. Suppose 
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2/3 < w < r < 2-12, and consider what can be done in four moves 
beginning at f = r? + 27r?. Notice that r — f = r7(1 — 2r?) and 
r? < 1/2. The probability of reaching the goal in four bold 
moves is therefore w[w + (w + ww)] = w?[1 + w(1 + ù). 

But now suppose that the gambler’s first move is to stake 
s = r? + fr? — rt and the remaining three moves are bold. If 
the first move is unsuccessful, the gambler finds himself with 
f — s = r?; and if successful, with f + 7s/r = r + řr?. The prob- 
abilities of attaining the goal from these two positions in the three 
remaining moves are easily seen to be w? and w + ww. The 
total probability of attaining the goal under the modified policy 
is therefore ww? + w(w + ww?) = w[1 + 20w] = 
w{1 + w(1 + w)] + wlw — 2], and the modified strategy is 
better than the bold strategy, since w > 2/3. 


According to arguments in Sections 5.5 and 5.6, bold strategies 
are optimal even for limited playing time if r = 1/2 (red-and-black) 
or if w = 1/2 (the taxed coin). Up to a point, these arguments 
extend to the general primitive casino, although, as Examples 1 and 2 
show, there are limits to this extension. Specifically, the inequality 
(5.5.6) is applied to fortunes in the arguments for r = 1/2 and to the 
probabilities S12, = R, in the argument for w = 1/2. We think 
that these applications of (5.5.6) must be viewed as two special devices 
that are without counterpart in the general situation. 


7. PRIMITIVE CASINOS IN RELATION TO 
GENERAL CASINOS 


A large class of casinos is generated by forming unions of primitive 
casinos, that is, by allowing the gambler at each move to choose w 
and r from among a set of possibilities P and then to choose a stake s 
(with s < f) to be bet in the primitive casino with parameters w and r. 
In self-explanatory notation, such a union of primitive casinos is 
determined by 


(1) ref) = U Taf). 


(w,r)EP 


For greater harmony in this section, let the domain of w and r be 
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extended to the values 0 and 1 that have heretofore been excluded 
as trivial. The new possibilities with r = 0 do not quite fall within 
the definition of Section 1, but they should clearly refer to those 
casinos in which each gamble results in the status quo f with prob- 
ability w and in any positive gain of the gambler’s choice with prob- 
ability w. 

According to the sufficiency proof of Theorem 4.2.1, if U is a 
casino function, it is the U of T p, where P consists of the pairs (U(r), r) 
for all r in [0, 1]. This remark, along with the corollary below, some- 
what justifies our adoption of the word “‘primitive’’. 


THEOREM 1. If U isa casino function (or even a bounded, nonzero 
solution of (4.3.1) and (4.3.2)) and w < U(r), then S,,-(f) < U(f) for 
all f. To put it a little differently, if U(r) > S,,-(r), then U major- 
izes Sy, 


Proof: Equation (2.3), and the following instances of the special 
casino inequalities, (4.3.1) and (4.3.3), show that if U(g) > S.,-(g) for 
a given g, the same is true for rg and for r + 7g. 


(2) U(rg) > U(r)U(g) > wU(g) = wS.,-(9) = Su,-(79); 
(3) U(r + 7g) > U(r) + U(r)U(g) 

> w + wU(g) 

> w + BS8w,r(g) 

= §,,-(r + 79). 


This settles the proof when U is continuous; the two discontinuous 
cases are trivial. œ 


The theorem can be recast to say that primitive casino functions 
Sw, are primitive for casino functions in somewhat the same way that 
linear functions are primitive for convex functions, thus: 


COROLLARY 1. Every casino function U is at each f the maxi- 


mum of those primitive casino functions S that U majorizes through- 
out [0, 1]. 


The converse to Corollary 1 does not hold. For consider the 
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maximum of a casino function and a primitive casino function that 
crosses it. This example shows a bit more: the maximum of two casino 
functions need not be a casino function. 


COROLLARY 2. If neither of the primitive casino functions S». 
and Se’. majorizes the other, then S,,,(r’) < w’ and Sy-,(r) < w. 
Consequently, for some f between r and 7’, So,- (J) = Sose (f). 


THEOREM 2. Let U be the strictly increasing casino function of 
a casino T, and suppose that U majorizes the primitive casino function 
Sa, Then U is excessive for the primitive casino I,,,; equivalently, 
U is the casino function of the union of T with Te,- If U(r) > w, then 
the only gamble in I,,,(f) conserving for the union at f is 6(f). 


Proof: Let y €Twu,(f). Then 


yU = wU(f + sr) + U(f — sr) 
Su,-(r)U(f + SP) + Su,-(r)U(f — sr) 
U(r)U(f + sf) + U(r) U(f — sr) 
UC), 


A l 


lA 


where the last inequality is an application of the casino inequality 
(4.2.1). Therefore U is excessive for T», The rest of the proof is 
obvious, especially in the light of Corollary 2.12.1. ¢ 


The U of the union of two casinos T, and T: such that U, majorizes 
U: can sometimes exceed U, (Theorem 9.2.5). Therefore not all 
casinos can replace the primitive casinos in Theorem 2; perhaps none 
other than unions of primitive casinos can. Of course in the special 
ease that U is fair, if I’ is any casino whose U’ is majorized by U, then 
I’ and U’ can replace Tu, and S.,, in Theorem 2. Perhaps no subfair 
U has this property of the fair U. 


8. MORE ABOUT PRIMITIVE CASINO FUNCTIONS 


The functions S,,, solve one of the simplest types of gambler’s 
problems; they are determined by simple functional equations; they 
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satisfy curious functional inequalities; they stand in a special relation 
to casino functions in general; and, unlike the “‘special functions” 
usually evoked by simple problems, they are in a sense highly irregular. 
For these reasons, study of the Sw., alone, and with respect to one 
another, seems promising. This section digresses to report and apply 
some facts on this topic. 

First, to review: For w andr in (0, 1), S», is characterized as the 
unique bounded solution of (2.1) for f in [0, 1]. The S», increase in f 
strictly, continuously, and (except when w = r) singularly, from 0 at 
f=Otolatf=1. They are definable parametrically, thus: S(a) = 
Qola), and f(a) = Q,(a). Each S,,, is related to S,,., Sm, and Sz 
by the identities (2.9). Forw =7,8.,,(f) =f. Forw < r, Sw, satis- 
fies the full casino inequality (4.2.1). Some special values of S are 
implicit in Table 5.2.1. 

The following remarks are little more than review: S.:(S:,(f)) = 
Sw7(f); for fixed f and r, S,,(f) is analytic in w in the domain 
{w: |w| <1, |1 — w| < 1}. 

Study of Si2,(f) = Q7'(f) as a function of r near r = f shows that 
Sw,- is not always differentiable, let alone analytic, in r. 

In common sense, S,,,(f) ought (for 0 < f< 1) to increase 
strictly in w from 0 to 1 and decrease strictly in r from 1 to 0. This 
conclusion is easily verified in steps: first for Q.(f) with f a binary 
rational of order 0, then of order n, and then of order œ; and finally 
for general w andr. A different and more intuitive argument will be 
given to illustrate Theorem 8.2.2. 

Since, for integral n, S(r”) = w”, it is suggestive to compare S 
with the function S’ for which this is true for all real n. 


(1) S'(f) = foe» = fareler = fa, 


with an evident abbreviation. For w = r, S’ is the same as S, and 
a=1. If wis less than r, then a exceeds 1 and S’ (like S) is a casino 
function, as was shown in Section 4.2. Therefore, in view of Theorem 
7.1, S’(f) majorizes S(f) for w < r (vice versa for w > r). 

Except when w = r, the only solutions of S’(f) = S(f) are f = r” 
(for nonnegative integers n) and f = 0. These values evidently are 
solutions. If any other f were a solution, repeated division by r 
would produce a solution f with r < f < 1, which leads to a contradic- 
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tion, thus. If, for example, w < r, then 


2) SP = S) = w + ws (2) 


< wS'(1) + w8’ (=) 


< 8’ (n +7 L- r) =S (f): 


Not only does S’ majorize S (for w < r), but S’ and S are of the 
same order of magnitude in that S(f)/S’(f) is bounded away from 0 
for f e (0, 1), which is more than is implied by (4.3.14). To see this, 
together with something else of interest, consider the logarithm of the 


ratio S/S’ as a function of z = — log f, namely, 
(3) beserat E2 250 
log r 


This function is continuous in z, because it is the logarithm of a positive 
continuous function, and it is periodic of period — logr = |log rl. 
The function (3) is therefore uniformly bounded, which is in effect 
what was to be proved. 

The relation between S’ and S has, of course, a dual stemming 
from (2.9)—specifically, from S,,,(f) = Sa.(f). The whole situation 
is summarized in the following theorem, which remains true if all the 
inequalities in it are simultaneously reversed and “min” is replaced 
by “max”. 

THEOREM 1. Ifw<r, 


(4) Sur < min (Sa, Ss), 

where 

(5) Salf) =f, Ss(f) =P= (o f, 
and 

(6) es log w B= we 
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When w=r7r, a2=B=1 and S(f) = Sf) = S8’(f) =f. When 
w < r, a >œ 1 > 8; the solutions of S(f) = S’(f) are 0 and r”; those 
of S(f) = S’’(f) are 1 and 1 — 7”; and the common solutions are 0, r, 1. 


When picturing the graphs of S, S4, and Sg it is helpful to know 
that Sa(f) — Ss (f) has the same sign as f — r for w < r, as is implicit 
in the proof of the next theorem. 


log r 


Figure 2 Some points on the graph of P(z) = — tog S(e-*) + log w | 


for (w, r) = (.2, .4). 


When attention is confined to w < rand w’ < 7’, the situation of 
interest, a number of questions suggest themselves as to when I.,,-(f) 
is at least as favorable, or just as favorable, as F», These questions 
are of course expressible in terms of S,,-(f) and Sy’,,(f). 

In the first place, S,,,(f) = f for all f if and only if w = r. If 
w <T, Sy.(r) = w < r, and since S,,,, is a casino function S,,,(f) < f 
for all f e (0, 1), in accordance with the passage beginning Section 4.4. 
With this remark, let the possibilities w = r and w’ = r’ be dropped 
from most of the further discussion. 
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A necessary and sufficient condition for S,,, to majorize S,,-,,/, 
but one not always convenient for theoretical problems, is that 
Sy,-(r’) > w, or, equivalently, that Q7’(r’) > Qz'(w’). Majorization 
need not be strict in (0, 1), in that S,,,(f) may be at least S,-,-(f) at 
all f, and equal to Sw’ at many but not all f. 


Example 1. Su, majorizes Sw, and the two functions are equal 
at f = r”, but Sy,-(r) = w > Su(7), in view of Theorem 1. 


A sufficient condition for majorization is that w > w’ andr < r. 
This is perfectly evident from the gambler’s viewpoint and is demon- 
strated by the strict monotony of Sin w and r. If either inequality 
is strict, the majorization is strict in (0, 1). 

If a > a’, f«/f* approaches 0 as f approaches 0. But S,-,--(f)/f@’ 
is bounded away from 0. Therefore, for f sufficiently small, S,,-,-(f) > 
fe > Solf). Dually, if B < B’, Su,(f) < Swo--(f) for f sufficiently 
close to 1. This principle has several applications. 


COROLLARY 1. A necessary condition for S,,, to majorize Sw, 
is that a < a’ and B > p. 


This condition is not sufficient, since the largest w’ compatible 
with it for given values of w, r, and r’, namely, min (r’*, 1 — 7'8), has 
an isolated corner as a function of r’, whereas the largest w’ allowed 
by the known necessary and sufficient condition is singular in r’. 

Next, if a > a’ and B > $’, the corresponding S,,,, and Sw’, cross 
each other in the sense that the first is smaller than the second for all 
small f and vice versa for large f. 


Example 2. One easy way to find examples of this kind of 
crossing is to try w = Fand r’ = w. Thenw < rentailsw’ < 7’; 
and a’ = 6-1, B’ = a~l. It remains only to find w and r for which 
aß > 1. But with w = 1/2 and f small, aß is rather close to 
(log 2)2/r|log F|, which is large. 


Two primitive casino functions can cross each other infinitely 
often. 


Example 3. Let r be less than r’ but a = log w/logr = 
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log w’/log r’. Then S.w,(f) < fe, and Sx-(f) < fe, with equal- 
ity in the first case only at f = r” and in the second at f = 7r’”, 
n =1,2,--+:. For typical choices of r and 7’, these points of 
contact with f@ are distinct. 


Finally, Theorem 1 leads to a demonstration of this anticipated 
theorem: 


THEOREM 2. For all w, 7, w, r’ in (0, 1). S», is identically Sw,» 
if and only if w = rand w = 7’, or w = w’ andr = r. 


Proof: It is evident that S,,,, is Sw, in the special cases provided 
for. On the other hand, if S», is Sw’, then necessarily a = a’ and 
B = p, that is, 


(7) log i = log 7 -8 
log r log 7 

or 

(8) Ww = re, D = 78, 


Ifw = r, thena = 8 = 1,andw = r’. Ifw = r,then (a — 1)(6 — 1) 
< 0; (8) of course has the solution w’ = w and r’ = r, but if it had 
another, there would be two different roots r’ of 


(9) re +(1—r)}—-1=0 
in the open interval (0, 1). Since (9) is satisfied by r’ = 0 and r’ = 1, 


there would be at least three distinct zeros in (0, 1) of the derivative 


of the left side of (9) with respect to r’, that is, at least three distinct 
roots of 


(10) are) = B(1 — r’)e-1, 


or, since £ is neither 0 or 1, of 


(11) ee jee. 
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This is impossible, for the left side of (11) is linear and the right side 
is strictly convex. ¢® 


THEOREM 3. For0 <w<r <1, S,,-(w) < 7 with strict inequal- 
ity unless w + r = 1. In particular, for 0 < w < 1/2, Q,(w) < 1/2. 


Proof: Sw, and S;,g are dual functions according to the remark 
following (2.9). If w +r = 1, and, according to Theorem 2, only 
then, S», is self-dual. Otherwise, neither Su,- nor S;,5 majorizes the 
other, in accordance with the observation near the end of Section 4.6. 
Apply Corollary 7.2 to conclude that S,,,(w) < F. œ@ 


As is easy to see, the w-coin distribution Y» whose distribution 
function is Q, has w as its mean. Therefore the final sentence of 
Theorem 2 can be interpreted thus: 


COROLLARY 2. For 0 < w < 1/2, the mean of the w-coin dis- 
tribution Y» is less than its median. 


Of course the identities (2.9) and Theorem 3 imply that Su, (0) > 7 
if0<r<w<il. In particular, Q,(0) > 1/2 for 1/2 < w < 1. 


COROLLARY 3. Q,(w) < Q;(w) for0 < w < 1/2. 


Corollary 3 can be interpreted as a partial answer to whether, 
in bold play at red-and-black, it is preferable to have a large probabil- 
ity of winning each individual bet with a small initial fortune or a 
small probability of winning each bet with a large initial fortune. 

It is now easy to refine Theorem 7.1. 


THEOREM 4. If U isa casino function (or even a bounded, nonzero 
solution of (4.3.1) and (4.3.2)) and w < U(r), then S..,.(f) < U(f) 
for all f in (0,1). Ifw < U(r), then Sv, < U. 


Proof: Choose w’ satisfying w < w’ < U(r). Then S,,(f) < 
Swrr(f) < U(f) for f in (0,1). The first inequality is the strict 
monotony of S in w, and the second is asserted in Theorem 7.1. ¢ 


9. UNIFORM ROULETTE 


A roulette table, like a primitive casino, is governed by two 
parameters wand r. In Nevada, w and r are 1/38 and 1/36 (Scarne 
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1961, p. 362). At Monte Carlo, w and r are 1/37 and 1/36, and the 
situation is more complicated (Scarne 1961, p. 356). Because of this 
disparity between Nevada and Monte Carlo rules and, more important, 
because the problem of optimal play at a roulette table remains open, 
there is no point in giving precise definitions here. If the bets open 
to the gambler are restricted somewhat, however, optimal strategies 
are easy to find and demonstrate, using knowledge of primitive casinos. 
A uniform-roulette table f.,, is the union of the primitive casinos 
Lor, Teaver, © © © , Inwnr Where n is the largest integer for which 
mr <1. When a gambler plays red-and-black in Nevada, he is, in 
effect, selecting a gamble from Tisw,18, where w and r are 1/38 and 1/36. 
More generally, if on a spin of the wheel he stakes s on each of j 
numbers, he is in effect selecting a gamble from I'j»,;,. A gambler at a 
uniform-roulette table may vary s and j on different spins. If on 
some spin of the wheel he stakes different positive amounts sı, --- , 5 
on 7 numbers, then his play is no longer uniform. A uniform-roulette 
table is plainly a casino in the technical sense of Chapter 4. 


THEOREM 1. If 0<w<r<l, and 0 <f <1, then S,,,(f) > 
Sjw,je(f) for all integers 7 > 1 for which jr < 1. 


Proof: According to Theorem 5.1, Sw,-(jr) > jSw,-(r) = jw = 
Sju,jr(jr). Now apply Theorem 8.4. 


THEOREM 2. The utility of the uniform-roulette casino I,,, is the 
primitive casino function S,,,. The only gambles in f,,,,(f) that con- 
serve Su, at f are in I,,,(f). 


Proof: Apply Theorem 1 and Theorem 7.2. œ% 


As Theorem 2 implies, the bold strategy based on the longest 
odds is optimal in a uniform-roulette casino. It is natural to con- 
jecture that this strategy is also optimal for not necessarily uniform 
roulette, but this remains unsettled. 


THEOREM 3. For all real j for which 0 < w < r < jr < 1, Sjuj-(r) 
is strictly less than w. 


Proof: Sjwg(r) = (JW)Siw (J) < (jw) j) =w. + 
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One might conjecture that it is not important for 7 in Theorem 1 
to be an integer. Indeed, Theorem 3 implies that S;~,;, cannot major- 
ize Su, if j > 1. Nevertheless, Sw, need not majorize S;,,,;, either. 


Example 1. Let r = 1/2, 7 = 4/8, and w be arbitrary in (0, 1). 
According to Table 5.2.1, S,,,.(2/3) = Sy,1/2(2/3) = Qu(2/3) = 
w(1 — ww)-!. Consequently, for w = 1/2, S,,,-(2/3) < 4w/3 = 
S 40/3,2/3(2/8). It seems noteworthy that, for all w < 1/2, Q, 
and S40/3,2/3 assume equal values at some point in the interval 


(1/2, 2/3). 


For 7 > 1, the a of Tv, is greater, and the 8 smaller, than the a 
and 6 of Ta,. Therefore, Example 1 illustrates concretely that the 
condition of Corollary 8.1 is not sufficient. 

According to Example 1, min {Swz.1(f): 0 < t< 1}, say 8,,,(f), 
can be strictly less than S,,,,(f), at least for r = f = 2/3. As Theorem 
4.6.1 implies, S.,.. is a casino function. Knowledge of other properties 
of this function is desirable—in particular, knowledge of interesting 
lower bounds for S,,,,(r). 


7 
SOME GENERAL 


PRINCIPLES 


1. INTRODUCTION. This chapter is about some general princi- 
ples that apply to gambling houses on any set F of fortunes, and 
the next is about some general principles that apply only when 
F is a set of real numbers. 

As a preliminary, certain facts and technical terms so natural 
that they might almost go unmentioned are catalogued. Some 
of them have been encountered in earlier sections. 

If r, and T: have the same space of fortunes F and T(f) D 
Y.(f) for all f in F (or Tı D Lo, for short), then T is a superhouse 
of Ts, and T» is a subhouse of Ti. If rı DT, the same relation 
subsists between the leavable closures TY and rý. If Ti DT 
> Tl. orl. DI DT,, then IL is between Tı and rs. 

The union Uae I. of a nonvacuous class of gambling houses 
on a fixed F is defined by 


(1) (Ua Ta) (f) = U. Telf) 


for all f in F. It is a superhouse of each Te, and (Ua Ta)? = 
Ue TZ. Typically, many strategies available in a union are not 
available in any one term of the union. 

“Intersection” and “N”? can almost be substituted for 
“union” and “U” in the preceding paragraph, but some dif- 
ferences must be mentioned. Since we have chosen to require, 
for a gambling house I, that I'(f) be nonvacuous, the intersection 
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of a class of gambling houses can fail to be a gambling house. It 
always is a gambling house if the elements of the class are leavable, 
and the intersection of a class is leavable if and only if the elements 
of the class are. A strategy is available in Ne TI. at f if and only if it 
is available in each I, at f. 


2. COMPOSITION 


Though the gambling house T permits the gambler with fortune f 
to use immediately only the gambles in ['(f), the gambler can, in 
effect, generally build up or compose other gambles for himself in the 
course of time. Since time here is at no premium, these composite 
gambles are, to all intents and purposes, as available to the gambler 
as are the elements of I'(f) themselves. If, for example, y er(f) 


and y, © I'(g), then the new gamble 7’ for which each bounded real- 
valued v has the expectation 


(1) vv = f vw dv(9), 


is effectively available at f. (This y’ is the distribution of the terminal 
fortune of an available two-move policy with initial fortune f. The 
expectation of v under y’ is the expectation under y of the conditional 
expectation of v under the conditional distribution y,.) 

More generally, if r = (e, t) is a policy available to the gambler 
at f, he can compose for himself y(r), the distribution of f; under v. 
Recapitulating (2.9.4), 


(2) y(r)v = ov(fr) 


for all bounded functions v. 

Possibly the operation (2), not to mention its special case (1), 
does not actually augment I(f) for any f. That is, perhaps y(r) e T(f). 
In this case, T is closed under composition. Even the y’ constructed 
according to (1) provide an adequate test of closure under composi- 
tion, as can be shown easily with or without the help of (2.9.7): 


THEOREM 1. If, for each f, every y’, in the sense of (1), is included 
in I'(f), then T is closed under composition. 
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A simple example of a gambling house T, closed under composition 
is constructed from any bounded, real-valued v with F as its domain 
by letting 


(3) T.(f) = fy: w < o(f)} = {y: vis excessive for y at f}; 


this is the full house under v. Reversal of the inequality in (3) and 
replacement of the inequality by equality also lead to houses closed 
under composition—the full house under —»v and the v-conserving house. 
The important special case of a house conserved by an exponential 
function was introduced and exploited in (de Finetti 1939) and is 
studied in Section 8.7. 

An intersection of any number of houses closed under composition 
is itself closed under composition. In particular, the intersection of 
any class of full houses is closed under composition and is leavable. 
A conserving house, for instance, can be viewed as the intersection of 
two full houses. Full houses will be discussed frequently again. 

Any house T determines its composition closure T°, the intersection 
of all superhouses of T that are closed under composition. The compo- 
sition closure of T can be defined much more constructively. Let 
IT”(f) = {y(r): t is available in T at f}, where y(c, t) is the distribu- 
tion under o of f; as in (2). 


THEOREM 2, T° = I”. 


Proof: Plainly, r° D T”. The reverse inclusion holds if T” is 
closed under composition. In view of Theorem 1, it is therefore 
necessary only to show that y” e T” (f), where y’"v = f yv dy” (g), 
whenever y” eT(f) and y; erT”(g) for all g. This is done with 
the help of (2.9.7). + 


If T is closed under composition, then T = T°, and whatever can 
be achieved by a policy available at f can also be achieved by a single y 
available at f, which sometimes (as in Section 9.2) simplifies the evalua- 
tion of U. 


THEOREM 3. IfT is leavable and closed under composition, then 
U(f) = V(f) = sup yu over y in I(f). 
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3. PERMITTED SETS OF GAMBLES 


A function v from fortunes to real numbers determines a set v° 
of gambles, 


(1) v? = {y: w <O}, 


the gambles permitted by v. Such permitted sets of gambles are 
introduced here because of the importance of some permitted houses, that 
is, houses in which each T (f) is the set of gambles permitted by some vy. 

A full house T, in the sense of (2.3) is, of course, the permitted 
house with v; = v — v(f), and these are the most important examples 
of permitted houses. Later sections will have much to say about full 
houses and a little about other permitted houses. The present section 
concerns mainly the relation between two functions v and w when the 
permitted set v° is a subset of w°, or w is (at least) as permissive as v. 

Since unbounded functions v are often of interest, a clear and 
appropriate convention is needed for the meaning of the inequal- 
ity w < 0. For this and later purposes, yv is extended to certain 
unbounded v by the foilowing familiar sequence of definitions: 

If v is nonnegative, yv = lim (y min (v, c)) as the number c 
approaches ©; with œ admitted as a possible value, yv always exists 


fornonnegativev. Ifvisnonpositive, yv = —y(—v). Foranarbitrary 
v, yu = yout + yv, provided at least one of the two terms is finite, 
where, as usual, vt = max (v, 0) and v = min (v, 0). 


In particular, w < 0 if and only if yot < © and yot < |ywrl, 
where |yv-| may be œ. 


THEOREM 1. 


(a) w < 0 for all y (that is, every gamble belongs to v°) if and 
only if v < 0. 

(b) w < 0 for no y (that is, v° is vacuous) if and only if v is 
uniformly positive (that is, there is an e for which v > e > 0). 

(c) 5(g) ev? if and only if v(g) < 0. 

(d) If f+ and f- are fortunes for which v(ft) > 0 and v(f-) < 0, 
then the two-point gamble y for which 


0) : (f*) 
D vif} = OU N = eS 


belongs to v°, and w = 0. 
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(e) If v is unbounded from below, there is, for every f, a two-point 


gamble y in v° with y{ f} arbitrarily close to 1. 
(f) If v is bounded from below, z = inf v < 0, and v(g) > 0, then 


—2Z 


3 — ee. 
(3) sup vig} ae 
and, for all y e v° and e > z, 

(4) vif: of) = <— 


Of course, each part of Theorem 1 has practical implications 
for a gambler constrained to choose a gamble from v°. For example, 
part (e) shows that, if v is unbounded from below and the gambler’s 
utility u is bounded, then the gambler can practically have his heart’s 
desire with a single two-point gamble in v°. Part (f) bounds what 
he can achieve in v° when v is bounded from below. 

If v < aw for some nonnegative constant a, then yw < 0 plainly 
implies that wv < 0; in short, v° D w°, or v is as permissive as w. 
Similarly, if v = aw for some positive a, then v? = w°; v and w permit 
the same gambles. Several paragraphs lead to the next two theorems 
asserting almost the converses of these facts. 

Evidently, from part (a) of Theorem 1, if w < 0, then v° D w° 
if and only if v < 0. The condition that v < 0 can, though arti- 
ficially, be written v < Ow. 

Suppose, for completeness, that w is nowhere negative. Then 
yw < 0 if and only if y{f: w(f) > 6} = 0 for each positive ô. If for 
each positive e there is a positive ô such that v(f) > e implies w(f) > ô, 
then yw < 0 implies wv < 0, or v° D w°. Conversely, if, for some f, 
v(f) > 0 and w(f) = 0, 6(f) is in w° but not in v°; similarly, if there 
is a sequence of distinct fortunes f; with w(f:) < i! but v(f:) > e > 0, 
a diffuse gamble on the sequence {f;} belongs to w° but not to v°. In 
summary, if w is nowhere negative, then v is as permissive as w if and 
only if, for every positive e, there is a positive ô such that v(f) > e 
implies w(f) > ô. (When discussion is restricted to countably 
additive y on some sigma-field with respect to which v and w are 
measurable, it is necessary and sufficient that v(f) > 0 imply w(f) > 0.) 
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Example 1. On (0, 1], let u(f) = fl —S), o(f) = f2, and w(f) = 0 
or 1 according as f is 0 or positive. Then u° Dv D w°, and 
neither inclusion can be reversed (though, in a countably additive 
setting, the second one could be). In this example there is no 
nonnegative a for which u < av. 


Suppose, finally, that the two sets of fortunes, Ft where w(f) is 
positive and F- where it is negative, are both nonvacuous. For any 
fortunes ft and f- in F+ and F-, consider that two-point gamble y 
carried by those two fortunes for which yw = 0. A necessary con- 
dition for v° D w® is that w < 0. Equivalently, —w(f-)o(ft) + 
w(ft)o(f-) < 0, or 


oF) o 0) 
a wf) = wF) 


If these necessary conditions obtain for all ft e F+ and f- e F-, then 
the range of neither side of (5) is vacuous, that of the right side is 
nonnegative, and there is some nonnegative number a between the 
supremum of the range of the left side and the infimum of the range 
of the right side. For such an a, v(f) < aw(f) if w(f) +0. If 
w(f) = 0, ôlf)w = 0, and ê(f\w < O implies v(f) < 0. So v < aw. 
Consequently, the condition that v < aw, which is always sufficient for 
v° D w°, is, in this case, also necessary. 

Condensing the three possibilities: 


THEOREM 2. yw < 0 implies w < 0, or v is as permissive as w, 
if and only if one of the following two conditions obtains: 

(a) w is nowhere negative, and for every positive e there is a 
positive 6 such that v(f) > e implies w(f) > ô. 

(b) w is somewhere negative, and there is a nonnegative a such 
that »(f) < aw(f) for all f. 


(The hypothesis of Theorem 2 says that no linear functional 
separates v from the cone generated by w and all nonpositive functions, 
so that v is in the “natural closure” of the cone, and part (b) says that 
then v must be in the cone itself. However, a rigorous formulation 
and proof along this line would not fall under the most elementary 
general theories; the need for part (a) seems symptomatic of a need 
for special handling.) 
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Except for two extreme and not very important cases, v° = w° 


if and only if v and w are positive multiples of each other: 


THEOREM 3. w <0 is equivalent to yw < 0, or v° = w°, if and 
only if one of the following three conditions obtains: 

(a) v and w are nowhere positive. 

(b) Condition (a) of Theorem 2 applies in both directions. 

(c) For some positive number a, v = aw. 


Proof: If v or w is nowhere positive, part (a) of Theorem 1 
establishes condition (a) of the present theorem. 

If v and w are nowhere negative, Theorem 2 implies condition (b) 
of the present theorem. 

If w, say, is somewhere positive and somewhere negative and 
v° = w°, then v < aw for some nonnegative a, according to Theorem 2. 
The possibility that v is nowhere positive is excluded, and so a is 
positive. The possibility that v is nowhere negative is now also 
excluded; so, according to Theorem 2, w < bv for some nonnegative b. 
Since v < aw < abv and since v(f) can be positive and can be negative, 
ab = 1, and v = aw. ¢ 


It is of some interest for gambling problems to determine, for a 
bounded function u, the supremum of yu over the y permitted by a 
function w. This is plainly the least number b (or — œ if and only 
if w is uniformly positive) for which yu < b for all y in w°, that is, the 
least number b for which (u — b) is as permissive as w. According 
to Theorem 2, there are two cases to consider. 

First, suppose w > 0. For which numbers b’ does (u — b’) satisfy 
condition (a) of Theorem 2? For those such that for each positive e 
there is a positive 6 such that wherever u(f) > b’ + «e, w(f) > ô; that 
is, numbers as large as 


(6) inf sup u(f). 


é6>0 w(f)<sé 


The number (6) is therefore b in this case. If competition is restricted, 
in a countably additive spirit, to gambles for which yw < 0 implies 
that y{f: w(f) > 0} = 0 (as when y is discrete), then (6) is replaced by 


(7) sup u(f). 
w(f) =0 
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And this value can obviously be approached by means of one-point 
gambles. 

Second, if w is somewhere negative, then b is the least number 
for which there is a nonnegative number a such that u < aw + b. 
The discussion on which Theorem 2 is based shows that the value of b 
in this case is not affected by restricting competition to one-point and 
two-point gambles. 

The description of b in the second case actually applies in the 
first case as well. The b thus described is obviously large enough. 
To see that it is not too large, suppose that w > 0 and b’ exceeds the 
number (6). There is a 6 such that, wherever u(f) > 6’, w(f) > ô. 
Suppose a > sup (u/s). Then u < aw + 0’. 


THEOREM 4. For a bounded u, sup yu over y in w° is the least b 
such that, for some nonnegative number a, u < aw +b. If wis 
nonnegative, (6) is an alternative evaluation. In this special case, 
(6) must be replaced by (7) if the competition is restricted to gambles 
for which y{f: w(f) > 0} = 0; and this latter bound remains valid 
even if the competition is restricted still further to one-point gambles. 
Except in the special case, neither the sup yu nor b is decreased if 
competition is restricted to one-point and two-point gambles. 


The following modifications of Theorems 2, 3, and 4 are left to 
the interested reader. 


THEOREM 5. yw =0 implies w <0 if and only if one of the 
following two conditions obtains: 
(a) w is nowhere negative or nowhere positive, and for every 
positive e there is a positive ô such that v(f) > «e implies |w(f)| > ô. 
(b) w is somewhere positive and somewhere negative, and there 
is a real number a for which v < aw. 


If v is nonnegative (positive) at some f where w is positive, then 
a in condition (b) must be nonnegative (positive); if v is nonpositive 
wherever w is negative, then a can be nonnegative. Therefore, if 
v(ft+) > v(f-) wherever w(ft+) > 0 > w(f-), then a can be nonnega- 
tive; so if v is of the form v’(w) with v’ nondecreasing on the range of w, 
then a can be nonnegative. 
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COROLLARY 1. yw = 0 implies yv = 0 if and only if one of the 
following two conditions obtains: 
(a) w is nowhere negative or nowhere positive, and for every 
positive e there is a positive ô such that |v(f)| > «e implies |w(f)| > ô. 
(b) w is somewhere positive and somewhere negative, and there 
is a real a for which v = aw. 


COROLLARY 2. yw = 0 is equivalent to yv = 0 if and only if 
condition (a) of Corollary 1 applies in both directions or condition (b) 
of Corollary 1 applies with a unequal to 0. 


Every part of Theorem 4 can be easily adapted to the set of 
gambles for which yw = 0, but only the main counterparts are 
explicitly expressed in the next theorem. 


THEOREM 6. For a bounded wu, sup yu over {y: yw = 0} is the 
least b such that, for some real number a, u < aw +b. Ifuisa 
nondecreasing function of w, then it is enough to admit nonnegative 
values of a. If w is nonnegative or nonpositive, (6) applied to |w| 
in place of w is an alternative evaluation of sup yu (whether u is a 
nondecreasing function of w or not). 


4. FULL HOUSES 


According to (2.3), T,, the full house under v, is the house for 
which T,(f) = (w — v(f))°. The assumption in Section 2 that v is 
bounded was made for momentary simplicity only and is now dropped. 
Clearly, T, is the largest house for which v is excessive. If both v and 
—v are excessive for a house T so that wv = v(f) for all f and all y eT (/f), 
then T conservesv. The largest house that conserves v, the intersection 
of T, and T—,, is the v-conserving house defined in Section 2. 

If v is excessive for T, then all av + b, with b real and a positive, 
also are. Therefore, v and av + b define the same full and conserving 
houses. The converse is also true. 


THEOREM 1. The full house under v is the full house under w if 
and only if 


(1) w = w +b 
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for some real b and some positive real a. The v-conserving house is 
the w-conserving house if and only if (1) holds for some real a and b 
with a = 0. 


Proof: As already mentioned, the “if” part of the first assertion 
is obvious. To prove the ‘“‘only if” part, consider first the situation 
in which v or w takes on at least three values. There is no further 
loss of generality in assuming that, for some f, v — v(f) is both some- 
where positive and somewhere negative. As follows immediately 
from Theorem 3.3, if rT, = Ty, then 


(2) w — w(f) = av — o(f)) 


for some positive a. This is equivalent to (1) and disposes of the 
situation in which v or w takes on at least three values. The remaining 
possibilities for the first assertion are trivial. Proof of the assertion 
about conserving houses is left to the reader. ¢ 


The assertion of Theorem 1 about conserving houses is close to 
(Hardy, Littlewood, and Polya 1934, Theorem 83, p. 66). 
Two simple principles: 


THEOREM 2. Ifu < aœ +b, then U < av + b for any subhouse r 
of the v-conserving house and, provided a > 0, for any subhouse 
of the full house under v as well. 


Proof: Immediate from the basic Theorem 2.12.1. œ% 


THEOREM 3. If u coincides with av + b at two fortunes, say f 
and h, and if T is a superhouse of the v-conserving house, then U (g) > 
av(g) + b at every g for which av(g) + b is between u(f) and u(h). 


Proof: The assertion is trivial unless the numbers u(f), u(h), and 
av(g) + b are all different, in which case there is no loss of generality 
in assuming u(f) < av(g) +b < u(h). Then, according to part (d) 
of Theorem 3.1, there is a v-conserving two-point gamble y in I(g) 
carried on f and h such that yu = ay + b = av(g) + b, which proves 
the assertion. Explicitly, 


_ rh) — (9) _ ulh) — [av(g) + b). 
(3) vif} Ih olf) O u 
(4) yina O LOK) ee), g 


oh) — olf) ulh) — ulf) 
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Example 1. Let v be any function on [0, 1] that attains its mini- 
mum at 0 and its maximum at 1, and let u(1) = 1 and u(f) = 0 
for f in [0, 1). According to Theorem 1, no generality is lost in 
assuming that v(0) = 0 and v(1) = 1. According to the first 
principle, U is at most v for any subhouse of the full house T; 
according to the second, this bound is achievable, even in the 
v-conserving house, by one-move, two-point policies. 


Example 2. Let v be defined on (—~,0], with 0 <v <1, 
v(0) = 1, and with infv = 0. This contrasts with Example 1 
only in that a partially diffuse gamble may be needed where a 
two-point gamble could be used before. If partially diffuse gam- 
bles are excluded, there remain arbitrarily good one-move, two- 
point policies; there are still optimal strategies but no optimal 
policies. 


Example 3. On the interval [0, 10], let v be convex and increas- 
ing, and let u(f) be the largest integer that is at most f. For any T 
between the v-conserving house and the full house under v and 
for fin [n,n +1] (n=0,---: , 9), 


(5) Uh) = v(n + 1) — v(n) 


as the two principles show. 


This example, unusual in this book in that it solves a problem 
with a many-valued utility u, admits a generalization that, in a sense, 
solves all gambling problems for conserving and full houses. The rest 
of this section is about this generalization (not used in later sections). 
Theorems 2.3, 3.4, and 3.6 are the tools for the generalization. 


THEOREM 4. If I is the full house under v, then 
U(f) = inf (av(f) + b) 


aver those numbers a and b for whicha > Oand av + b > u. Atanyf 
at which v attains its minimum, 


(6) U(f) =inf sup u(y). 


6>0 v(g)<v(f) +5 


184 Some general principles [Chap. 7 


THEOREM 5. IfT is the v-conserving house, then 
U(f) = inf (av(f) + b) 


over those numbers a and b for which av + b > u. If u is a non- 
decreasing function of v, then it is enough to admit nonnegative values 
ofa. At any f at which v attains its maximum or minimum, 


(7) U(f) =inf sup  u(g). 


S 
8>0 |v(9) —v(/I|<é 


It is easy to see how (6) and (7) have to be modified if T is replaced 
by its subhouse of one-point and two-point gambles. 


5. PERMITTED HOUSES 


Some interesting gambling houses are constructed from a family 
of functions v; from the fortunes to real numbers, one function for 
each f, by letting '(f) = {y: ws < 0}. In the terminology of Section 
3, T is a permitted house, and T(f) = v$. Full houses are interesting 
examples of permitted houses, as are income-tax casinos (defined in 
Section 9.2), but later sections rely so little on the present section that 
some may prefer to skip or defer it. 

Practically any family v; permits some gambling house Tr. What 
is needed is simply that no v; be uniformly positive so that every v; 
is nonempty. However, v,;(f) must be nonpositive if I is to be 
leavable. 

Immediately from Theorem 3.3: 


THEOREM 1. If TI is permitted by v; and v; assumes both positive 
and negative values for each f, then T is also permitted by v; if and 
only if v; = a(f)v; for some positive a( f). 


The solution of gambling problems often hinges on finding 
appropriate excessive functions. 


THEOREM 2. Suppose that T is permitted by v;, a(f) > 0, and 
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b(f) is real. If, for all f and g, b(g) < a(f)vs(g) + b(f), then b is 
excessive for T. 


Theorem 2 will be illustrated in Section 9.2. We are largely 
in the dark as to when nontrivial functions a and b exist. 

A permitted house can be closed under composition, as has already 
been illustrated by the case of full houses. 


THEOREM 3. Ifv; — 2;(g) is at least as permissive as v, for all f 
and g, then the house permitted by the family vs is closed under 
composition. 


Proof: Suppose wv; <0 and Yw, < 0 for all g. Under these 
assumptions and the hypothesis of the theorem, 


(1) yos = f vers dyla) < f vrlo) arg) < 0. 


Now apply Theorem 2.1. ¢@ 


COROLLARY 1. Ifv;(f) < 0 and vs — v;(g) is at least as permis- 
sive as v, for all f and g, 


(2) U(f) = V(f) = sup yu. 
vyEr(f) 


Under a mild hypothesis, Theorem 3 has a converse. 


THEOREM 4. If each v; assumes both positive and negative values 
and if v;(f) < 0 for all f, then the house T permitted by v; is closed 
under composition if and only if vs — v;s(g) is at least as permissive as 
v for all f and g. 


Proof: The “f” clause is more than covered by Theorem 3. 

As for the “only if” clause, let y be a two-point gamble carried 
by, say, h and g, such that yv; = 0 and y{g} > 0; such a gamble 
exists for an arbitrary f and g under the preliminary hypotheses of the 
theorem. Let ye = 6(e) if e ¥ g, and let y, be any gamble for which 
Vv, < 0. Thus y eT(f) and y. eT (e) for alle. If I is closed under 
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composition, then y’ = f ye dy(e) is an element of I'(f), and 


(3) 0 > y'o = | vers dr(e) 
= vs(h)yih} + (vers)vig} 
= —a,(g)v{g} + (vorr)vig} 
= (—2;(g) + Yors) vig}. 
Since y{g} > 0, vo(vy — vs(g)) = —vuslg) + Yws L0. + 


Theorem 3.4 implies the final theorem and evident refinements 
of it. 


THEOREM 5. If the house permitted by v; is leavable and closed 
under composition, U(f) is the infimum of those numbers b for which 
u < av; + b for some nonnegative a. 


8 


1. 


HOUSES ON THE 
REAL LINE 


INTRODUCTION. This chapter studies certain properties of 


gambling houses for which the space of fortunes F is a set of real 
numbers. Those who prefer to proceed from the specific to the 
general may prefer to read the chapter backwards or to look 
first through its last section, which is largely independent of the 
earlier ones. 


2. DOMINATION 


In this section, F is assumed to be a subset of (— œ, œ). 
If y is a gamble on F and S is any subset of (— œ, œ), yS will 
mean y(F A S). If v > y’v for every bounded, nondecreasing, 
real-valued function v on F, then y dominates y’. 


THEOREM 1. y dominates y’ if and only if, for all f in F, 
vf, =) 2 v'[f, ©) and y(f, ©) > y'(f, ©). 


Pairs of gambles that dominate each other are closely equiva- 
lent for many purposes. 


COROLLARY 1. y and 7’ dominate each other if and only if 
they agree on all intervals. 


COROLLARY 2. If y dominates y’ and yv < œ for a non- 
decreasing but not necessarily bounded v, then y’v exists and 
yv < yw. 
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If A is a set of gambles and y is a gamble that some element of 
A dominates, then A dominates y. The set of gambles dominated 
by A clearly includes A and can be A itself, as in the following corollary 
(where v° is as in (7.3.1)). 


COROLLARY 3. Ifv is nondecreasing, the set of all gambles domi- 
nated by v° is v° itself. 


If a set of gambles A dominates every element of a set A*, then 
A dominates A*. If I'(f) dominates I'*(f) for all f, then T dominates T*. 


THEOREM 2. If I dominates I'*, then every nondecreasing func- 
tion v excessive for T is excessive for '*. If U is nondecreasing, then 
U is excessive for rT* and majorizes U*. 


Proof: Apply Theorems 2.12.1 and 2.14.1. œ 


(Theorem 2 suggests an argument for the strict monotony of 
the primitive-casino functions S.,,,,(f)—increasing in w and decreasing 
in r for 0 < f < 1—more natural than the combinatorial argument 
sketched in the paragraph preceding (6.8.1). Theorem 2 yields 
monotony in the right direction immediately; that this monotony is 
strict in w follows from (5.2.1); finally, the conclusion for r is immediate 
from that for w.) 

If r(f) dominates ['(f’) whenever f > f’, then T increases (not 
necessarily strictly) in dominance. As would be expected, if T increases 
in dominance and u is nondecreasing, a rich gambler can do as well 
as a poor one—at least if T is leavable: 


THEOREM 3. If u is nondecreasing and T increases in dominance, 
then Un, U.,, and U are nondecreasing. 


Proof: Inthe notation introduced parenthetically in Section 2.15, 
U; = u is nondecreasing, and if Uz is nondecreasing for 8 < a, then 
Ua is nondecreasing. By transfinite induction, U4 is nondecreasing 
for all a, whence U is nondecreasing. @ 


COROLLARY 4. If I dominates I'*, T increases in dominance, 
and u is nondecreasing, then U majorizes U*. 
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(Under the hypotheses of Corollary 4, U, and U., majorize Už 
and US. But the composition closure of I need not dominate that 
of I'*, as easy examples show. It would do so under the following 
slightly weaker but less simple definition: A “dominates” y if, for each 
positive e, there is a y’ in A such that y’v > w — e for all nondecreasing 
v bounded between 0 and 1. Substituting this alternative definition, 
Corollary 3 and Theorem 2 remain true for v bounded from below, 
and—strengthening the original assertions—Theorem 3 and Corol- 
laries 4 and 5 remain true as stated.) 


COROLLARY 5. If I is increasing in dominance and u is non- 
decreasing, then U is determined by the values that the gambles 
assign to the intervals (as are U, and Ua). 


(Though Corollary 5 extends Corollary 4.5.1 from casinos to 
houses that increase in dominance, the corresponding extension of 
Theorem 4.5.2 is false. We have not determined whether Theorems 2 
and 3 and Corollaries 4 and 5 apply to V.) 

One particularly strong way for a house to increase in dominance 
is to have I'(f) DT(f) whenever f > f’; such a house increases in 
freedom. 


LEMMA 1. If T increases in freedom and f > f’, then every strategy 
available in T at f’ is also available at f. 


THEOREM 4. If I increases in freedom, then V and U are non- 
decreasing for every u. 


Suppose, to consider the most important sort of utility function, 
that, for some fortune g, u(f) = 0 for f < g and u(f) = 1 for f >g. 
Just what functions U can occur for a T that increases in dominance? 
First, U must be nondecreasing according to Theorem 3. Second, for 
leavable T, U must be 1 at f > g. Third, either inf U = 0 or U = 1, 
as Theorem 3.8.5 says. 

The three conditions are not only necessary ; they are also sufficient, 
and even sufficient for a function U to be the U of the full house under 
U, which is of course increasing in freedom as well as in dominance. 
(Compare Theorems 7.4.2 and 7.4.3, and Examples 7.4.1 and 7.4.2.) 
Presumably, the situation with regard to V is not very different. 
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3 MONOTONE HOUSES 


In this section the space of fortunes will be an interval unbounded 
from above, usually (— œ, œ), [0, ©), or (0, ©); and in contrast 
to the preceding section, the arithmetic, or group theoretic, relations 
among the fortunes will play a role. 

The set of lotteries available in T at f is O(f) = [T(f) — f] (accord- 
ing to the usage established for casinos in Section 4.1). Say that T is 
increasing (not necessarily strictly) in displacement if, for all f and f’ 
with f > f’, O) D O(f’); it is decreasing in displacement if O(f) C 
@(f’) and stationary (in displacement) if O(f) = O(f’). In terms of 
I'(f), these concepts can also obviously be expressed thus: T is increas- 
ing, decreasing, or stationary in displacement if and only if, for all f 
and all positive t, [[(f) + ¢] is a subset of, is a superset of, or is equal 
toT(f + £). Since houses that are increasing in displacement are also 
increasing in dominance, conclusions in the preceding section apply 
to them. 

There might, of course, be but one lottery 6 available in the entire 
house. Such one-lottery, or random-walk, houses are stationary and 
correspond to sums of independent, identically distributed random 
variables. They will receive special attention in Chapter 10. 

Henceforth, when F is (— œ, œ), u(f) will be understood to be 0 
for negative f and 1 for nonnegative f. In this framework one might 
ask what functions U actually arise if T is a monotone house, that is, 
one which is increasing or decreasing in displacement. 


THEOREM 1. These three conditions are equivalent for a U on 
(= Ry æ ): 

(ay U is the U of a house that increases in displacement. 

(b) U is the U of a house that increases in dominance. 

(c) 0 < U <1; U(f) = 1 for f > 0; U is nondecreasing; and the 
infimum of U is 0, or U = 1. 


Proof: A house that increases in displacement certainly increases 
in dominance; so (a) implies (b), which in turn implies (c), as Theorems 
2.3 and 3.8.5 make evident. It is also evident that 1 is the U of a 
house that increases in displacement. What remains is to see that (c) 
implies (a) when inf U = 0. 

Let ©*(g) consist of all one-point and two-point—or even of all— 
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lotteries available at g in the full house under U, and let @(f) be the 
intersection of all @*(g) for g > f. Evidently, the gambling house 
thus constructed is leavable, increasing in displacement, and such 
that U is excessive for T. 

Finally, as will now be shown, for each f and each positive e less 
than U(f), there is a two-point 0 in @(f) for which 6{ —f} = U(f) — e. 
This is trivial if U(f) is 0 or 1; otherwise, let 6{e} = 1 — (U(f) — e) 
for some e with U(e) < e. This 0 €e ©(f), as is verified by calculat- 
ing thus for g > f. 


[0 + g]U = (U(f) — Ug — f) + A — (UF) — U + e) 
< (Uf) — pl + le = U(f) < Ug). + 


If a house on (— œ, ©) is decreasing in displacement, a poor 
man can imitate a rich one; so a gambler whose fortune is f + g, where 
f and g are negative, can rise to at least f with probability nearly U(g) 
and, if successful, continue on to 1 with probability at least U(f), as 
Sections 2.9 and 2.10 make rigorous. Therefore, 


(1) U(f +g) > UPU)  forf,g < 9. 


Also, as usual, U(f) = 1 for f> 0, 0< U <1; and inf U = 0, or 
U =1. 

Whether the conditions are sufficient for a U to be the U of a 
house decreasing in displacement we do not know. They obviously 
are if, and only if, U is the U of the largest subhouse of the full house 
under U that is decreasing in displacement; that is, O(f) is the inter- 
section of ©*(g) for all g < f, where ©*(g) is, as in the proof of Theorem 
1, the set of all lotteries 0 for which f U(g + x) d@(x) < U(g). Tke U 
of this house is evidently majorized by U. If U approaches 0 as f 
approaches — ©, the conditions are sufficient. For then U is attain- 
ablein T. In fact, forf < 0, let o(f){-—f} = U(f) and @(f)(— ©, g) = 
1 — U(f) for allg < 0. Then, forg <f <0, 


LOC) + g]U = Ug — PAUC) < UG). 


It would be interesting to know whether U is attainable if only 
gambles countably additive on the intervals are used. Even if this 
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is not true in general, it might be under the conditions of the next 
theorem. 


THEOREM 2. U on (— œ, œ) is the U of a stationary house if 
and only if it satisfies (1) and condition (c) of Theorem 1. 


Proof: Proceeds along the lines of the above discussion and the 
proof of Theorem 1. œ 


Whether V can replace U in (1) we do not know, but easy variants 
of (1) are 


(2) Omin(f + 9) = Un(f)U.(9); 
(3) U(f +9) = U.(f)U.(9). 


The U of a stationary house need be neither continuous nor 
strictly increasing. 


Example 1. If O(f) consists, for every f, of the two-point lottery 
that attaches probability w to +1 and w to —1 for some w, 
0 < w < 4, then U(f) is well known and easily seen (by Theorem 
2.12.1) to be (w/w) for nonpositive f, where (f) is the greatest 
integer not greater than f. 


If the U of a stationary house is continuous at 0, then it is con- 
tinuous at all f, as follows immediately from (1). 

Example 1 shows that the U of a stationary house need not be 
strictly increasing. Nonetheless, if U(f) = 0 for some negative f, 
then it is 0 for all f, as follows from (1) and the monotony of U. 

We do not know whether a nonconstant U must be strictly 
increasing if it is continuous. Continuity and strict monotony of U 
are easy to establish for many stationary houses and some others, 
thus: 


THEOREM 3. If, for some 9, [t6] is available at every f in a rT on 
(— œ, o) for all ¢ in (0,1), blz, ©) > 0 for some positive xz, and 
6[— ©, y) approaches 0 as y approaches — œ, then U is continuous. 
If, in addition, 6(— ©, y) = 0 for some real y and U(f) < 1 for some f, 
then U is strictly increasing on (— œ, O]. 
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Proof: Apply Theorem 2.14.1. 


When the space of fortunes consists of the nonnegative real 
numbers, houses that are stationary or decreasing in displacement 
are of academic interest at most. For the lotteries in such houses— 
all of them contained in ©(0)—must be carried on the nonnegative 
real numbers; and gambling with no possible loss of money is not 
exciting. 

The group of dilatations (about 0), the mappings that carry zx 
into tx for positive t, plays the same role on (0, œ) as translations 
do on (— ©, œ); for the positive numbers under multiplication are, by 
taking logarithms, isomorphic to the additive group of real numbers. 
A house T on [0, ©) or (0, ©) is zncreasing, decreasing, or stationary in 
dilatation according as O(éf) D [tO(f)] for all f > 0 and for ¢ in [1, œ), 
(0, 1], or (0, ©). These relations can be expressed in just the same 
way in terms of [(f); for T'(éf) = [O(é¢f) + tf], and this includes [tr (f)], 
or [tO(f) + tf], if and only if O(tf) includes [tO(f)]. 

In these terms, a casino is seen to be a gambling house on the 
nonnegative reals that is increasing in displacement and decreasing 
in dilatation, and in which @(0) contains only 6(0). A rich man’s 
casino is one that is stationary in dilatation. 

The problems of which functions can be the U of a house on (0, œ) 
that increases, decreases, or is stationary in dilatation when u is 0 for 
fin (0, 1) and 1 in[1, œ) are isomorphic to the corresponding problems 
about displacement; so there is no need to paraphrase the preceding 
paragraphs of this section. The analogue of (1) is 


(4) U(fg) > U(f)U(g), 


and the analogue of the exponential function with nonnegative à is 
f^. The corresponding problems for U on [0, ©) seem uninteresting. 


4. INCREASING FULL HOUSES 


If the full house under v on an interval J, unbounded from above, 
increases in displacement, then v increases in displacement. The prob- 
lem of the present section is to characterize such functions. A partial 
answer flows with but little effort from Theorem 7.3.2. Namely, 
v increases in displacement on (— ©, ©) if and only if, for every f and g 
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with g > f, there is an a(f, g) > 0 such that 
(1) v(g + A) — vlg) < alf, DWG + A) — 2(f)] 


for all A. 

The extension of this partial answer to other intervals and, still 
more, the exploration of (1) cost some effort, which we hope will be 
repaid by its analytic if not its gambling interest. 

The problem of this section bears on the theory of utility. For 
if v is interpreted as a person’s utility function, then v increases in 
displacement if and only if the person’s timidity increases with his 
wealth. 

The function f? on [0, ©) is easily seen to be increasing in dis- 
placement, but there is no nonnegative a(f, g) satisfying (1) for f = 0. 
Therefore, in extending the partial answer to an J with a lower end- 
point, some special provision will have to be made. Also, it is some- 
times useful to adapt (1) to all intervals open on the right. A function 
v on an interval J of positive length without an upper endpoint is 
miserly if for every f in J—except possibly if f is both the lower end- 
point of J and a minimum of v—there is, for every g > f, ana(f,g) = 0 
satisfying (1) for all A for which (f + A) and (g + A) are in J. 

Of course, if v is miserly on J, so is av + b fora > 0. Similarly, 
v(af + b) is miserly on (J — b)/a. These trivial transformations will 
be freely used. When we say that f is an endpoint of J, we always 
mean, in part, that f €J. 


LEMMA 1. Suppose v on J is miserly and attains its minimum, 
say 0, at some g’. If g’ is interior to J, then v(f) = 0 for every f 
interior to J. If g’ is the lower endpoint of J, then v is nondecreasing 
on J and continuous from the right in the interior of J. 


Proof: If g’ is interior to J, v(g’) = 0, A > 0, and (g’ + A) and 
(g’ — A) are in J, then 


(2) vlg + A) = vlg + A) — vlg’) < ag’ — A, g’)[v(g’) — vlg — A)] 
—a(g’ — A, g’)o(g’ — A) < 0. 


Therefore v(g) = 0 for every g greater than g’. Unless v(g) = 0 
for every g interior to J, there is an fy interior to J such that v(f) > 0 
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for f < fo and v(g) = Oforg > fo. This implies a contradiction. For 
if g —-A< fo <g, then (1) implies that a(g — A,g) = 0, but if 
g — 2A is also in J, 


(3) 0 < vlg — A) = v(g — A) — v(g) 
< alg — A, g)[v(g — 2A) — vg — A)]. 


Suppose now that 0¢J and is the lower endpoint of J, and 
v(0) = 0. Then 


(4) v(g — f) — o(9) < aff, g)[v) — o(f)] < 0 


whenever 0 < f < g; so v(g) is nondecreasing. If, further, f is a point 
of continuity of v and A is small and positive, 


(5) 0 < vg + A) — vg) < alf, g)[v(f + A) — (f) 
= a(f,g)o(1) = o(1). + 


THEOREM 1. A function v, on an interval J unbounded from 
above, increases in displacement if and only if it is miserly. 


Proof: The “‘if’’ clause is evident when the exceptional possibility 
does not obtain. It follows in general with the help of Lemma 1. As 
Theorem 7.3.2 shows, the “only if” clause applies for all g > f, except 
possibly if v(f) = min v and f is not a lower endpoint of J. In the 
exceptional case, the penultimate sentence of Lemma 1 shows that v is 
constant in the interior of J; so (1) applies with a(f,g) =0. œ+ 


For some insight into the implications of Theorem 1, suppose that 
v is rather regular. 


LEMMA 2. Ifv on an open interval J has a finite derivative ù that 
is positive (negative), then v is miserly if, and only if, log ù is concave 
(log —ù is convex). 


Proof: The two cases are very similar; only that of positive ù 
will be treated here. If v is miserly, f is interior to J, and f < g, then 


(6) d(g)A + o(A) < alf, g)[o(f)A + o(A)] 
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for small A; so 


; PELO] 

(7) a(f, g) if) 

Applying (1) tof, g, and A for A > 0 and to f =f+A,g’=g9g+A4, 
and A’ = —A, 


(8) alf, g)[o(f + A) — v(f)] = vlg + A) — v(g9) 
> a(f + A,g + Aef + A) — (f) 
> 0. 


In view of (7) and (8), 0(g)/#(f) is nonincreasing, and so log ù is concave. 
Conversely, if log ò is concave, the mean value theorem shows 
easily that the a of (7) is effective in (1); so v is miserly. ¢ 


If a nonnegative function is concave, so is its logarithm; if the 
logarithm of a nonnegative function is convex, so is the function. 


Example 1. The function \(A — 1)f* on (0, ©) is miserly—or, 
equivalently, increasing in displacement—for all real à. For 
`A > 0, (A — 1)f* is miserly on [0, ©), but, for A < 0, with no finite 
value of v(0) can f* be extended to be miserly on [0, œ). 


Some functions increasing in displacement are more or less 
irregular. 


Example 2. If (0) is arbitrary and v(f) = 0 for f > 0, then v is 
increasing in displacement on [0, œ). 


Example 3. Ifv is nondecreasing and miserly on J, then so is 
w = min (v, 1). 


Example 4. Ifv is nonincreasing and miserly on [0, ©), v(0) can 
be arbitrarily increased without disturbing either property. 


Example 5. If H(f) is a Hamel function—that is, a not neces- 
sarily linear function on (— ©, œ) for which H(f + g) = A(f) + 
H(g)—then H(f) and e?™ are increasing in displacement. 
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Example 5 shows that there are nonmeasurable functions that 
increase in displacement. Such irregular functions do not serve our 
present purposes; we want ultimately to confine the discussion to 
monotonic functions, but some readers will share our interest in seeing 
that a measurability assumption has the same effect. The rest of this 
section is only about such economy-of-regularity hypotheses. 


LEMMA 3. Ifv is miserly on J, and f, g, f + A, and g +A are 
in J with g > f, then v(f + A) — v(f) < 0 (= 0) implies v(g + A) — 
v(g) < 0 (2 0). 


Proof: If A is nonnegative, the conclusion follows from (1), with 
one exception covered by the final sentence of Lemma 1. If A is 
negative, the same argument applies with f’ = f + A, g’ = g +A, and 
A’ = —Ain place of f, g, A. ¢ 


(P. R. Halmos contributed to the proof of the next lemma.) 


LEMMA 4. If v on [0,1) is Lebesgue measurable and miserly, 
then v is monotonic. 


Proof: Let P = {A: v(A) > v(0)} and N = {A: (A) < v(0)}. 
In view of Lemma 3, if0 <f<f+A <1, theno(f + A) — vf) =0 
if AEP and <0 if AEN. Therefore P/n C P and N/n C N for 
every positive integer n. Also, (P/2) + (P/2) = P, and (N/2) + 
(N/2) = N. Evidently P and N are Lebesgue measurable, and 
(0,1) = PUN. So (P/2) U (N/2) = [0, 1/2), and either P/2 or 
N/2 has positive measure. Therefore, P = (P/2) + (P/2) or N = 
(N/2) + (N/2) must have an interior point, according to a slight 
variant of a well-known fact (Halmos 1950, Theorem 16B, p. 68). It 
is now clear that P or N is [0, 1). + 


LEMMA 5. Let v be miserly on J. If v is monotonic on some 
subinterval K of positive length, then v is monotonic throughout J. 
If v is constant on K but is not constant on J with its lower endpoint 
deleted, then v is nondecreasing and, for some fo interior to J, v is 
strictly increasing in J O (— ©, fo] and constant in J A [fo, ©). 


Proof: If v is not constant on K, the first assertion is easily 
derived from Lemma 3. 
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If v is constant, say a, on K, then it may be constant on the whole 
of J or on J minus its lower endpoint. In these trivial cases, herewith 
set aside, the lemma is obvious. Let fo be the least element of J 
such that v(f) = a for all a > fo; in the nontrivial cases fo exists and is 
interior to J, as Lemma 3 implies. 

If v is monotonic in any interval of positive length to the left of fo, 
it cannot be constant in that interval; so the first assertion of the lemma 
applies to show that v is strictly monotonic to the left of fo. Otherwise, 
there exist f and gin J with f < fo < g and v(f) = a. Also, for some 
positive A, g — A > foand v(f + A) — v(f) and a — v(f) are of strictly 
opposite signs. For some positive integer n, fo <f + nA < g, and 
v(f + nA) — o(f) = a — v(f) is of the same sign as v(f + A) — o(f), 
which is a contradiction. 

What remains is only to show that v on J A (— œ, fo] does not 
exceed v on J O [fo ©). Consider f and g with f < fo < g and 
(2g — f) and (2f — g) in J. Since 


(9) 0 = v(2g — f) — v(g) < alf, g)[v(g) — v), 


v(g) = v(f) or a(f, g) = 0 and v(g) < v(f). But the latter case leads 
to a contradiction: 


(10) 0 < o(f) — og) = v(g — (g — f)) — (9) 
a(f, g)[v(2f — g) — v(f)] 


0. ¢ 


IA 


LEMMA 6. Ifv is miserly on J and is Lebesgue measurable in some 
subinterval of positive length, then v is monotonic on J. 


Lemma 6 is reminiscent of, and in effect an extension of, the 
fact that a measurable Hamel function is linear. For, clearly, Hamel 
functions are miserly, and monotonic Hamel functions are linear. 


LEMMA 7. If vis miserly and strictly monotonic on an open inter- 
val J, then, for all f in J, the derivative ò(f) exists, is finite, and is 
different from 0. 
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Proof: Consider f, g, and h in J, with f < g < h, and such that 
o(f) and o(h) exist and are finite. Since h is not a maximum for v, 
a(g, h) > 0. 


(11) alf, D(f + 4) — v(f)] = alf, g)o(f)A + o(A) 
> v(g + A) — vg) 


[v(h + A) — v(h)] 


ae h) 
_ _o(h) 
SGD A + o(A). 
Therefore, 
(a 
(12) af, DOA) = soy = O 


So #(g) exists and is finite for all g in J. Since v is therefore absolutely 
continuous, it can now be assumed that o(h) = 0 and concluded that 
i(g) #0. + 


LEMMA 8. Ifv on [0, 1) is miserly and nondecreasing and if v is 
not constant on (0, 1), then v is continuous on [0, 1). 


Proof: In view of Lemmas 5 and 6, the only possible discon- 
tinuities are at 0 and at the fo of Lemma 5. Also, according to Lemma 
5, v is strictly monotonic in (0, 1) or in (0, fo). 

Consider first the behavior of v at 0. For fixed A and small 
positive e, 


(13) v(A) — v(A + «) < ale, A + €)[v(0) — v(e)] 


= AF 9 1) — vo] 

d(€) 

in view of (12). Since v is continuous at A and increasing at 0 and 

since, in view of Lemma 2, (A + e)/#(e) is nonincreasing in e, v(e) 
must approach v(0). 

According to Lemma 1, v is continuous to the right for f > 0; 

so the only remaining possibility of a discontinuity is a jump down 
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from fo For0 < e< e < fo — A, 
(14) 0<) — olho — 6) 

< = 9) yf, — a) — ofp — A - 9] 


~ o(fo — e — A) 
Ùl fo — €o) : 
= ih—-« ao” i 


THEOREM 2. Ifv on J is Lebesgue measurable on a subinterval 
of positive length, then v is miserly if and only if it is of one of the 
following types: 


(a) v is constant, except possibly at the lower endpoint of J. 

(b) v has an everywhere finite derivative +, which is positive 
except possibly at the lower endpoint of J, and log ù is concave. 

(b’) v is continuous, and, for some fo interior to J, it is of type (b) 
in J OA (— œ, fo] and constant in J A [fo, ©). 

(c) v has an everywhere negative derivative +, which is finite 
except possibly at the lower endpoint of J, and log —d is convex. 

(c’) v is strictly decreasing on J and of type (c) on J minus its 
left endpoint. 


COROLLARY 1. Ifv and —v are both measurable and miserly, 
then v is of type (a), linear, or of the form ae® + b. 


THEOREM 3. If w is such that w(v) is miserly whenever v is, then 
w is linear and nondecreasing; if w(v) is miserly whenever v is miserly 
and nondecreasing, then w is of the form min (af + b,c) for some 
a => 0. 


5. FULL-HOUSE CASINOES 


This section studies under what conditions a full house under a 
function v is a casino. The remaining two sections of the chapter do 
not depend on this one, but there are a few references to this section 
in the next chapter. 

What to require of (0) in a casino and whether to regard 0 as 
an element of a casino at all are petty matters. Until now it has 
been most convenient to include 0 and to require T(0) to be {6(0)}, 
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but full houses that are casinos in just that sense are rare and uninter- 
esting. A slightly modified definition is therefore adopted here: A 
gambling house T on [0, ©) or on (0, ©) is a castnoe—rhymes with 
“canoe’—if it is leavable, if @(g) D O(f) for g > f (increasing in 
displacement), and if O(éf) D [t@(f)] forO0 < fand0 < t < 1 (decreas- 
ing in dilatation relative to (0, ©)). 


THEOREM 1. If I is a casino, it is also a casinoe on [0, ©). If 
T’ is a casinoe on either [0, ©) or (0, ~), and r(f) = r’(f) for f > 0 
and (0) = {6(0)}, then T is a casino, and U(f) = U’(f) for f > 0. 


COROLLARY 1. On [0, ©), U’ is the U of some casinoe if and 
only if U’ is the U of a casino or U’= 1. On (0, œ), U’ isthe U of a 
casinoe if and only if U’ coincides on (0, ©) with the U of a casino. 


If the full house T, under v on [0, œ) oron (0, ©) is a casinoe, then 
v is a casinoe maker. A preliminary characterization of casinoe makers 
on (0, œ) is almost immediate from Theorem 4.1 and the isomorphism 
f’ = —logf. In view of this isomorphism, v(f) on (0, ©) decreases 
in dilatation if and only if v(e7) on (— œ, œ) decreases in displacement. 


LEMMA 1. On (0, œ), v is a casinoe maker if and only if, for all f 
and g with 0 < f < g, there are nonnegative a(f, g) and b(f, g) such 
that 


(1) vg + A) — vlg) < aff, g)[v(f + A) — (P) 
and 
(2) b(f, g)lv(gr) — v(g)] = o(fr) — o(f) 


for all A > —f and A > 0.. 


The next lemma follows easily from the definition of casinoe and 
from consideration of the available one-point lotteries. 


LEMMA 2. Each casinoe maker on (0, ©) is strictly monotonic 
or constant. 
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Lemma 2 is reminiscent of the fact that the only isomorphism 
of the (semi) field of (positive) real numbers into itself is the identity 
(Dieudonné 1960, p. 83). 


LEMMA 3. On (0, ©), v is a casinoe maker if and only if v is differ- 
entiable and satisfies one of the following three conditions: 

(a) ù is strictly positive, log #(f) is concave in f, and log #(e*) is 
convex in Z. 

(b) ù is strictly negative, log —#(f) is convex in f, and log —#(e’) 
is concave in z. 

(c) v is constant. 


Proof: Case (c) is obviously a possibility. Failing case (c), a 
casinoe maker is strictly increasing or strictly decreasing according to 
Lemma 2. The proof is easily completed by application of Lemma 1 
and Theorems 4.1 and 4.2 to v(f) and to v(e-*). 


Example 1. (a) Letv(f) = e" forsomeX > 0. Then log d(f) 
Af + log is concave, barely; and log d(e7) = Xe? + log is 
strictly convex. 

(b) v(f) = e- for some id > 0. 


Example 2. (a) Let v(f) = fe for some œa > 1. Then log o(f) = 
log a + (a — 1) logf is concave—strictly concave, unless a = 1; 
and log o(e?) = log a + (a — 1)z is barely convex. 

(b) v(f) = fe for some a < 0. 


(b’) Let v(f) = — log f to see a casinoe maker that is bounded 
neither from above nor from below. 


b”) —f*for0<a<1l. 


A casinoe maker is not only differentiable; it is twice differentiable 
and nearly three times differentiable. 


THEOREM 2. The following conditions are equivalent on (0, ©): 


(a) v is a nonconstant casinoe maker. 
(b) v, —i/d, and fi/d are all nondecreasing or all nonincreasing. 
(c) ö is absolutely continuous, # > 0, and, introducing q for i/2, 


ras 


(3) —-1<—-<0 


2 | 


except for a set of Lebesgue measure 0, unless i = 0. 
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Proof: Suppose v is as in case (a) of Lemma 3, and let Fr and 
Fz denote right and left differentiation with respect to f, and Zr and 
Zz with respect to z. 


sap = PRA) < Fa) 
(4) Fr log i(f) (7) < oa 
© Beno = ay = Hey ee He 


Therefore, Fri(f) = Frò(f), and i(f) exists. A similar argument 
applies to case (b) of Lemma 3. Conditions (a) and (b) of the present 
theorem are now seen to be equivalent, in the light of Lemma 3, by 
elementary calculation. 

Now suppose condition (b) obtains. If q were 0 at one point, 
it would be identically 0. Since g must be positive or negative accord- 
ing as ù is positive or negative, # is always positive. If, for instance, 
q is positive and decreasing, 


(6) 0 <f) — af +A) <ER arta) — of +A) 


a- 


7 q(f + A). 


Since g is a bounded function of f for f bounded away from 0, (6) shows 
that q is absolutely continuous. Since # exists everywhere and is 
positive, + is absolutely continuous. Now that é is seen to be the 
product of two absolutely continuous functions, it, too, is absolutely 
continuous. As then follows easily by differentiating the terms in (b), 
—1 < fd/q < 0 whenever g exists. Similarly, (c) implies (b). ¢ 


The characterization of casinoe makers on (0, ~) achieved by 
Theorem 2 is transferred to the more interesting interval [0, ©) by 
the next theorem, proof of which, being both straightforward and 
somewhat tedious, is omitted. Natural tools are Theorem 4.2, Lemma 
1, the extension of (2) to X = 0 for a casinoe maker on [0, œ), the 
uniqueness of b(f, g) for strictly decreasing casinoe makers implied 
by the multiplicative form of (4.10), and Lemma 2. 


THEOREM 3. On [0, ©), v is a casinoe maker if and only if one 
of the following conditions obtains. 
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(a) v is strictly increasing and continuous, and v restricted to 
(0, ©) is a casinoe maker there. 

(b) v is strictly decreasing and continuous, and v restricted to 
(0, ~) is a casinoe maker there. 

(c) v is constant on (0, œ). 


THEOREM 4. The restriction of each casinoe maker on [0, ©) to 
(0, ©) is a casinoe maker on (0, ©). For strictly increasing casinoe 
makers on [0, ©), this mapping is one-to-one and onto the strictly 
increasing casinoe makers on (0, ©). For strictly decreasing casinoe 
makers on [0, ©), this mapping is also one-to-one, and its range is 
strictly decreasing casinoe makers on (0, œ<) that are bounded from 
above. 


Proof: Since increasing casinoe makers are increasing convex 
functions and so bounded from below, this theorem is immediate from 
Theorem 3. @ 


Part (b) of Example 1 shows that a decreasing casinoe maker on 
(0, ©) may not be extendible to [0, ©). In connection with the 
usual u, only strictly increasing casinoe makers are interesting. Atten- 
tion is therefore confined now to strictly increasing casinoe makers on 
[0, ©). These, so normalized that v(0) = 0 and v(1) = 1, will be 
called normalized casinoe makers. 


THEOREM 5. Ifv is a normalized casinoe maker, then v restricted 
to [0, 1] coincides with the U of the casinoe that is the full house under 
v, and hence is a casino function. 


Proof: See Example 7.4.1. ¢@ 


Theorem 5 provides a fertile way to identify casino functions— 
though of a very limited sort—as the next paragraph illustrates. 

Lawrence Jackson was the first to show that, for each a between 
1 and 2, convex combinations of f and f* are casino functions. His 
proof was a direct verification that such convex combinations satisfy 
the casino inequality (4.2.1). Here is an alternative proof which 
shows that such convex combinations are not only casino functions 
but normalized casinoe makers. 
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THEOREM 6. The full house under a convex combination of f 
and fe for 1 < a < 2 is a casinoe. 


Proof: Let v(f) be a convex combination of f and fe. Then 
alf) = w(f)/o(f) = kfe-?/(1 + cf!) for some positive k and c; q(f) is 
decreasing in f, and fo(f) is increasing in f. Apply Theorems 2, 3, 
and 5. + 


Convex combinations of casinoe makers are not generally casinoe 
makers. For, as reported in Section 4.3, Lawrence Jackson and Roger 
Purves have shown that, for a > 2, no proper convex function of f and 
fe is a casino function, let alone a normalized casinoe maker. 

The rest of this section is about the generation of new casinoe 
makers from old ones. In the first place, it is not easy to generate 
new ones by composition of old ones. This is important only insofar 
as it explains the interest of later theorems, and so we do not give the 
proof in detail. 


THEOREM 7. The function w(v) (v(w)) is a strictly increasing 
casinoe maker on (0, ©) whenever v itself is if and only if w is strictly 
increasing and linear (strictly increasing, linear, and positive for 
positive f). 


Proof: It is easy to see by testing with o(f) = f that w must be a 
strictly increasing casinoe maker. Exploration of the test functions 
v(f) = a+ be¥ for ` > 0 shows that this is impossible except for 
linear w. @ 


There is some freedom of composition for the derivatives of 
casinoe makers. 


THEOREM 8. y(x) is the derivative of a strictly increasing casinoe 
maker on (0, ©) whenever z is if and only if y is of the form af* for 
some a > 0 and c > 0. 


Proof: According to Theorem 2, what is required is that y be 
positive and that —y(x)z/y(x) and fy(x)z/y(x) be nondecreasing in f, 
whenever z is a positive function for which —%/z and fz/x are nonde- 
creasing. Testing with z(f) = f, you see that y is positive and —y/y 
and fy/y are nondecreasing. Testing with x(f) = ae’, you see that 
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xzy(x)/y(x) is nonincreasing in x and therefore constant. The only 
possibilities remaining for y are now af‘, with a > 0 and c > 0, and 
with such a y, y(x)z/y(x) = cét/x. ¢ 


The question about z(y) is more complicated. We merely pre- 
sent a not very satisfying theorem and give an example. 


THEOREM 9. z(y) is the derivative of a strictly increasing casinoe 
maker on (0, ©) whenever z is if and only if y is positive on (0, œ), 
and —y(f) and fy(f)/y(f) are nondecreasing. 


Proof: What is required of y is that —z(y)y/zx(y) and fz(y)y/x(y) 
be defined and nondecreasing whenever x is positive and —z/zx and 
fz/x are nondecreasing. Of course, y has to be positive if z(y) is to be 
defined. Testing with x(f) = f shows that fy(f)/y(f) must be non- 
decreasing. Testing with r(f) = ef shows that y is nonincreasing. 

The conditions are sufficient: To begin with, they imply that 
y > 0; otherwise y would become negative for large f. Since «(y)/z(y) 
is nonnegative and nonincreasing in y, <(y)y/z(y) is now seen to be 


nonincreasing in f. Similarly, f<(y)y/x(y) = (fy/y)(yt(y)/z(y)) is 
nondecreasing inf. @ 


Example 3. Ify(f) = fe, then —y(f) = —ef™ and fy(f)/y(f) = c 
are nondecreasing if and only if 0 < c < 1. 


Associated with a strictly increasing nonlinear casinoe maker v 
on (0, ©) is the function B for which 


(7) B(f) = rot 


Theorem 2 shows that B is positive and that B and — B/f are non- 
decreasing. Call such a function a casino basement and call B the 
basement of v. 


THEOREM 10. Every casino basement is the basement of exactly 
one normalized casinoe maker. 


Example 4. Examples 1(a) and 2(a) have the basements `~? with 
` > 0 and f/c with c > 0. 
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If (7) looks upside down, that is mainly to ensure that the identity 
function be a basement, which makes the next theorem prettier than 
it would otherwise be. 


THEOREM 11. The function C(B) (B(C)) is a casino basement 
whenever B is if and only if C is a casino basement. 


Proof: Testing with B(f) = f shows that each condition requires 
C to be a casino basement. If B and C are both casino basements, 
plainly C(B) is nondecreasing. Similarly, 


C(B(f)) _ CBO) BO) 
f BG) f 


is nonincreasing. @ 


COROLLARY 2. Casino basements form a semigroup with respect 
to composition. 


Example 5. The function af? is a casino basement if and only 
ifa>0Oand0<b<1. These functions obviously constitute 
a noncommutative two-parameter semigroup; (a’, b’) - (a, b) = 
(a’a’, b’b). Ifv has af? as its basement, then 


fi 
(8) o(f) = K exp aao 


for some positive K. 
Example 6. Let p, q,r, and s be real numbers; then 


pf +a 
rf +s 


is a casino basement if and only if it is constant or no two of the 
coefficients p, q, r, and s have opposite signs and the determinant 
d = (ps — qr) is positive. For the casinoe makers corresponding 
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to the three-parameter semigroup with d > 0, 


K (7 + ay" ert lp for p ~ 0 
(9) o(f) = p i 


Kel f+2s)/2¢ for p = 0. 


The first part of Theorem 11 has an easy extension to functions ¢ 
of n variables defined on (0, œ)”. 


THEOREM 12. (Bı, ;: - - , Ba) is a casino basement whenever 
Bı, -- > , Ba are casino basements if and only if ¢ is positive, is nonde- 
creasing in each argument, and ¢(tzı, © © © , ttn) < tọl(£i, © © © , Xn) 
for all positive zı, - - - , £an and for t > 1. 


Example 7. Any function @ of n arguments that is positive, 

nondecreasing in each argument, and homogeneous of degree 1— 

in short, any function that could be called a ‘‘mean’’—satisfies the 

condition of Theorem 12. In particular, let a; > 0, for 7 = 1, 
- ,n, and È a; = 1, and consider: 


(10) > (aix) 7 for r =Æ 0, 
(11) I] 2%, 

(12) max qiti, 

(13) MIN qiti. 


Example 7 shows that the class of casino basements is convex 
in the ordinary sense, and in many other senses as well. 

As Theorem 2 makes clear, a casino basement B is absolutely 
continuous and leads to a sub-basement S defined by 


(14) S) = f Flog BO) = FO 


almost- everywhere. Modulo null functions, the sub-basements are 
simply the measurable functions on (0, œ) that are bounded between 
0 and 1. 
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Strictly increasing, convex casinoe makers v and v’ clearly have 
the same sub-basement if and only if B and B’ are proportional to 
each other, that is, if and only if #’ = aé¢ for some positive a and c. 
Compare Theorem 8. 


Example 8. If S = b with 0 <b < 1, then B(f) = afè for some 
a>0O. See Example 5. 


Of course, the set of all sub-basements is convex in the ordinary 
and in practically any other sense, and its extreme points are in many 
senses the indicator functions of measurable sets. 


6. STATIONARY FULL HOUSES 


If the full house under v on (— œ, œ) is stationary in displace- 
ment, then v is stationary in displacement. According to Theorem 4.1, 
v is stationary in displacement if and only if v(f) and v(— f) are both 
miserly. According to Corollary 4.1, if v is measurable throughout 
some interval of positive length, v is then stationary in displacement if 
and only if ù is constant or logò is linear or log —# is linear. This 
conclusion will now be rederived in a more familiar way, with the slight 
advantage of finding the nonmeasurable possibilities. 

The full house under a constant consists of all gambles and is 
therefore stationary in displacement. Setting this trivial possibility 
aside, suppose that v is a nonconstant function stationary in displace- 
ment. According to Lemma 4.1, it is impossible that v should attain 
a minimum. To postulate for the moment that v(0) = 0 and that 0 
is neither a maximum nor a minimum of v is now a mere affine renor- 
malization. Exploiting the fact that (4.1) must apply with g = 0 
regardless of the sign of f (because v is miserly in both directions), 
you can easily verify (along the lines of the proof of part (c) of Theorem 
7.3.3) that for some positive function a 


(1) of’ +f) = aW) + o(f) 


for all f and f’. The problem remaining is to characterize the not 
identically vanishing solutions of (1) with a(f) positive. This latter 
problem (with references to Nagumo, de Finetti, and Jessen) is essen- 
tially solved in (Hardy, Littlewood, and Polya 1934, pp. 68, 69) as 
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follows. Equation (1) implies that a(0) = 1 and also a(f)v(f’) = 


a(f’)v(f) + o(f), whence a(f) = kv(f) + 1 for some constant k, and 
(1) is equivalent to 


(2) oF +f) = kol fW + of) + o(f), 
with the condition kv(f) + 1 > 0. 

Ifk = 0, 
(3) of +f) = of) + of), 


or v is additive. In this case, as is well known, v is either simply 

of the form af or else extremely wild—nonmeasurable with a graph 

dense in the whole plane (Hardy, Littlewood, and Polya 1934, p. 96). 
If k = 0, (2) is equivalent to 


(4) alf +f) = a(fja(f’), 


where a(f) = kv(f) + 1 and is strictly positive. Therefore log a exists 
and satisfies (3). In summary: 


THEOREM 1. The full house under v is stationary in displacement 
if and only if v is of one of the following mutually exclusive types or an 
affine transformation thereof. 

(a) v(f) = e for some A = 0. 

(b) o(f) =f. 

(c) v(f) is a discontinuous solution of (3). 

(d) log v(f) is a discontinuous solution of (3). 

(e) v(f) = 0 for all f. 


Of the five possibilities listed in Theorem 1, only (a), and perhaps 
(b), will ordinarily be of interest. Possibilities (b) and (c), being 
unbounded from below, are not of interest in connection with any 
bounded utility u. Possibilities (c) and (d) allow one-point transitions 
from each fortune to an everywhere dense set of fortunes and are 
therefore of no interest in connection with even moderately regular 
utilities; possibility (e) allows all gambles at each fortune and is, 
therefore, of no interest in connection with any utility. 

Since the full house under v on the real line is increasing in dis- 
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placement if and only if the full house under v* on the positive reals 
is increasing in dilatation, where v*(f) = v(log f), and since a casino 
is a rich man’s casino if and only if it is stationary in dilatation, 
Theorem 1 has this corollary: 


COROLLARY 1. The full house T under a function on [0, œ) is a 
fair or subfair rich man’s casinoe if and only if T is the full house 
under f* for some A > 1. 


COROLLARY 2. The full house T under a function on (0, œ) is a 
superfair rich man’s casinoe if and only if T is the full house under a 
constant or under one of the functions in part (b), (b), or (6) of 
Example 5.2. 


Recognition that the characteristic feature of a poor man’s 
casinoe on (0, œ) is an adaptation to (0, œ) of stationarity in displace- 
ment leads, with a little effort, to the conclusion that the only full 
houses on (0, œ) that are poor man’s casinoes are the full houses under 
e's for some à, or under f or —f. 


7. EXPONENTIAL HOUSES 


The importance of the \-exponential houses, that is, the full houses 
under functions of the form e is suggested by Theorem 6.1. In the 
A-exponential house a gambler whose fortune is f may use any gamble 
y for which f e dy(g) < e”. 

This section is largely a report of the research of others. For the 
topic of exponential houses has a long history, mainly under somewhat 
different guises. We hope, though, that there are some new points 
here and that this collation and unification of the material will be 
useful. 

De Finetti (1939, 1940) introduced and studied the concept of 
insurance companies that sell only lotteries, for which the expected 
value of e is 1 for some negative à, evaluating the probability that 
such an insurance company will ever go bankrupt starting with a 
positive fortune. It is but a change in conventions and in mathe- 
matically irrelevant value judgments to view de Finetti’s problem 
as that of a gambler who wants to arrive at a nonnegative fortune 
starting with a negative one in a house that conserves e~ for some 
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positive A. De Finetti’s work on exponential houses has greatly 
influenced this section. De Finetti traces his own ideas on the topic 
through (Bertrand 1907, Section 92) to De Moivre (1711, Problem IX; 
1718, Problem VII). 

The considerable literature about a topic known as Wald’s funda- 
mental identity of sequential analysis is related to houses that conserve 
eM for some à. See, for example, (Wald 1947, pp. 159-160), (Doob 
1953, pp. 350-352), and (Bahadur 1958) for various points of view 
on this identity and for further references. For still other references 
and for presentation of closely related matters see also (Kemperman 
1961) and (Hoeffding 1963). Still others have touched on exponential 
houses, as later parts of this section will bring out. 

The importance of exponential houses is suggested by Theorem 
6.1, according to which the functions U, where U(f) = e", are 
(except for oriented affine transformations) the only functions that 
generate interesting full houses stationary in displacement. 

Since 


[6 + f]Uy 


f Ux(g + f) dolg) 


Ux) | Ux) dolg) 
Ux(F)(60)), 


the gamble [6 + f] conserves, decreases, or increases U, at f according 
as 0 conserves, decreases, or increases U, at 0. In particular, the 
gamble [0 + f] is available at f in the \-exponential house if and only if 
f e d6(g) <1. For this reason, the Laplace transform Lẹ (or simply 
L) of the lottery 6 is of interest for exponential houses, where 


(1) L(A) = 0U, = f es d6(f). 


The following theorem is a list of facts about the Laplace transform. 
Except possibly for a few easy details, these are widely known and 
used; see, for example, (de Finetti 1939), (Wald 1947), and (Girshick 
and Savage 1951). Proofs of the less obvious assertions will be found 
in (Widder 1941, Sections VI1 and VI2). To conform with conven- 
tion, and for simplicity, the theorem is confined to lotteries 6 for which 
6(—g, g) approaches 1 as g approaches œ. 
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THEOREM 1. If Z is the Laplace transform of a lottery 0 for which 
6(—g, g) approaches 1 as g approaches œ, then: 

(a) L(0) = 1. 

(b) 0 < LA) œœ. 

(c) fà: L(A) < œ} isan interval C. (Any interval that contains 
0 can occur.) 

(d) On C, L(A) is continuous and strictly convex, unless 6(—e, €) 
= 1 for every positive e, in which case L(A) is 1 for all X. 

(e) With the possible exception mentioned in (d), L(A) = 1 for 
at most one A different from 0, say (6). 

(f) {\: L(A) < 1} is a closed interval D, and the possible con- 
figurations are these: (i) There is a \(@), and D is the interval joining 0 
to (6); (ii) D consists of 0 alone; (ii) D = C A (— ~, 0], or D = 
C A [0, œ). 

(g) In the interior of C, L is analytic. 

(h) In the interior of C, (1) can be differentiated any number of 
times under the integral sign. With usual conventions about infinite 
and about one-sided derivatives, this applies even to the endpoints 
of C if C does not consist of 0 alone. In particular, 


E 


(2) dy" 


Lo) | _ = | PAD, 


provided ČC does not consist of 0 alone. 

(i) If, for some positive e, 0(e, ©) > 0, then L(A) is not bounded 
in [0, œ). 

(j) If, for some positive e, 0(e, ©) > 0, 0 is subfair, and C includes 
[0, ©), then (6) exists. 


To see the small changes entailed in Theorem 1 by inclusion of 
lotteries for which 6(—g, g) is uniformly less than 1, consider first the 
Laplace transform L, of any lottery 6, concentrated in the neighbor- 
hood of +0;Z,(A) = 0 for à < 0, = 1 forà = 0, = +œ for > 0. 
Similarly for the Laplace transform of a lottery concentrated near — ©. 
The most general Le is a convex combination of L,, L_, and an L of 
the type covered by Theorem 1. If L} and L_ both have positive 
coefficients in this convex combination, then L(A) = œ except when 
= 0. If, for example, L_ has a positive coefficient, then Le(A) = © 
for à < Oand = 1 for à = 0, and Z,(0 + 0) < 1 if Le is finite for some 
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positive A. Actually, such a jump down to the right or left of 0 is 
the only possible discontinuity for a Laplace transform, apart from 
the jump to œ from the endpoints of C. As is easily checked, Theorem 
1 remains correct without the exclusion of any lotteries, except for the 
possibility of a jump down at 0 and the possibility that Le(A) vanishes 
if 6 is 6, or 6_. 

Most of the parts of Theorem 1 have direct implications for the 
theory of exponential houses. In particular, part (e) implies that 
only trivial lotteries can belong to the \-conserving house for more than 
one nonzero i, and part (7) gives a frequently applicable condition 
for the existence of one such A, \(@). Again, part (f) implies that if, 
for example, 0 < X < X, then the -exponential house is a subhouse 
of the \-exponential house; this monotony is strict, since two-point 
\-conserving gambles exist. 

Since 


(3) KAU = f e AA) 


= | e dolf) = 0Un, 


[t0] conserves U, at 0 if and only if 0 conserves Un at 0. In view of 
part (f), if 6 depresses U,, so does [t0] for ¢ in [0, 1]. 

Let u be the indicator function of the nonnegative numbers. 
With this u, what is U for the \-exponential house? According to 
Section 7.4, U = 1 if \ <0, and U = min (Uj, 1) for positive à. 
This evaluation applies to any subhouse of the \-exponential house 
that contains all two-point, \-conserving gambles. It is of primary 
interest for positive A, and à will be assumed positive throughout 
much of the rest of the section. 

For any subhouse of the \-exponential house (A > 0), U(f) = e 
is an upper bound for U(f); if a gambler is restricted to lotteries 0 for 
which f e dé(g) < 1, then the probability that his fortune ever 
increases by x is bounded by e—* foreach x > 0. In applications, this 
upper bound is often close, as has been emphasized by de Finetti (1939) 
and by Wald (1947). Suppose, for example, that each ©(f) contains 
a certain nontrivial 0 that conserves e, A > 0. Study the strategy c 
initiating at f, f < 0, and repeating 6 indefinitely or until f» is first 


Sec. 7] Exponential houses 166 


nonnegative. The following martingale-like formula can be inter- 
preted and justified even in a finitely additive theory. 


(4) e = H,(e) = H,(e|f, > Ojule) > ule). 


Any upper bound on the conditional expectation in (4) amounts to a 
lower bound on u(c) and, therefore, on U. 

In one case only is u(c), for such a “‘random-walk”’ strategy o, 
exactly e“. As is not hard to see and as is no doubt well known, this 
is when @ is concentrated on (or barely to the right of) a sequence of 
numbers of the form A, 0, —A, —2A, --- , and f/A is an integer. In 
this case, f; is macroscopically greater than 0 with probability 0. 

The formula 


(5) Ee f: > 0) = E (E| fr = 0, fr) fe 2 0) 
= E,(Eg(ed@rthe-»|z + fi—1 > 0)| f: > 0), 


whatever details might be involved in its careful interpretation, sug- 
gests that 


(6) Tas eò (z—w) d6(z) 


Mel f, > 
=o ge) ee 

f i e@—v) d6(z) 
< sup —— SS ——_- 
a oe olw, o0 ) 


The inequalities (6) can be established either by careful interpretation 
of (5) or by means of Theorem 2.12.1. 

As de Finetti (1940, pp. 73-74) pointed out, there is one case 
in which the two extremes of (6) coincide, namely, when the denom- 
inators Ofw, ©) are of the form Ae-- for some p, p >. In this 
case, according to (4) and (6), ule) = [1 — (A/p)Je’, which is not 
much smaller than e if \/p is small. 

Obviously, if 0 is bounded from above, so that 6[B, ©) = 0, then 
(4) with (6) permits the conclusion that e > u(c) > eM—B. Analysis 
along the lines of (4) and (6) has also been given for lotteries 0 with 
normal distributions (Wald 1947, Appendix 2.5). 
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Turn now to the -exponential casinoe, the full house under e~. 
According to Example 7.4.1, for the U of this casinoe, 


U(f) — U0) _ ev — 1 
U,(1) — U,(0) A — 1 


(7) U(f) = 


for f in [0, 1] and A > 0. 

Recalling that the two limiting fortunes 0 and 1 ordinarily adopted 
for a casino are conventional only, rewrite (7) for a casinoe on the 
interval [—z, ©) with 0 as the goal, thus. 


Mf — ed — e-detS) 
6 pee 


(8) Uf) =$ 


Pen ez 1 ae e—rz 


for f in [—z, 0]. Note that, once z is so large that A(z + f) is large, the 
influence of z in (8) is small. 

The close isomorphism between the -exponential house on the 
real numbers and the full house under the function f* on the nonnega- 
tive reals has already been emphasized. For à > 1, these latter 
casinoes are, according to Corollary 6.1, the only fair and subfair 
rich man’s casinoes that are full houses. The U of such a house is 
itself f` forf < 1. Facts for exponential houses have their counterpart 
for these casinoes; for example, f* is an upper bound, often quite good, 
for the probability of ever reaching 1 starting with an initial fortune f 
in a subhouse of such a casinoe. 

The rest of this section is about applications of the general theory 
of exponential houses sketched above. Often a given house I of 
interest is a subhouse of a \-exponential house T}, in which case e” 
is an upper bound for U(f). An evaluation of the largest A for which 
rT C T is often equivalent to finding the best exponential upper bound 
for U. The problem typically reduces to the evaluation of (6) for 
certain lotteries 6. For when \(@) exists and is positive, it is the largest 
\ for which 6 belongs to the \-exponential house. Hence the largest à 
for which r C T is the infimum of the numbers \(@) as 0 ranges over 
all lotteries available in T at any f. When the exact calculation of A(0) 
is difficult, it may be more illuminating to determine a certain simple 
approximation J(@) to \(@), as will soon be made apparent. 
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Suppose first that 0 has a normal distribution with mean u and 
variance a7, nu < 0 < o°. 


1 
9) Lo(d) = —— [ Met- gf: 
i i V 2r i f 
consequently, 
(10) LN) = gh(2u+ro?) /2_ 


Therefore \(@) = —2yu/o?. Call I(0) the inequity of any 6 that has 
finite positive variance o? and mean u, whether @ is normally dis- 
tributed or not, and abbreviate it to J(@). As is now evident, when 
every 0 in @(f) (except 6(f)) has a normal distribution with Z(0) > I 
> 0 for some J and all f, then T is a subhouse of the J-exponential 
house. Therefore, U(f) < e forf < 0. This upper bound is often 
close, or even exact. For instance, as is known in connection with 
sequential analysis, if each O(f) contains a fixed 0 with normal distri- 
bution of negative mean yw and variance o?, and if J(6) = J, then 
U(f) = Ur(f){1 — O(u/c)] uniformly in f and J for f in (— œ, 0] and 
I in (0, ©); see (Wald 1947, Appendix 2.5). 

Even when 9 is not normal but is nearly fair in some sense, J(6) 
promises to be close to (@). One of us, Savage, first heard of this 
heuristic significance of J(@) as an index of the undesirability of a 
lottery indirectly from Jesse Marcum, and it stimulated Savage’s 
interest in gambling problems. The idea of J(@) as an approximation 
to (@) was published relatively early (de Finetti 1939). De Finetti 
(1940, p. 64) gives the following mathematical interpretation to this 
idea: 

Let y be a lottery of mean 0 and variance 1 such that Ly(A) < © 
for some positive \, and let 6 = [oy + u] for some positive o and 
negative u. The mean, variance, and inequity of 0 are u, c, and 

= —2y/c?. 


(11) L(A) 


J eMostn) dyf) 


= ero(ule) f eros dy(f) 


erly (x) , 


168 Houses on the real line [Chap. 8 


where x = do and y = w/o. Clearly, Ly(z) > lforx>0. If, fora 
positive x, L(x) is finite, then Le(A) = 1 for some sufficiently negative 
y. 
(12) log Le(A) = zy + log L(x) 

= 2(y + 2 log L,(2)). 


Aside from the trivial solution z = 0, Ze(A) = 1 if and only if 
(13) y = —x" log L(x). 
Since Ly(z) = 1 + $2? + O(23), 
(14) y = —3x + O(2?). 
According to the implicit function theorem, 
(15) z= —2y + Oly’). 


Substituting Ao for x and u/c for y in (15), 


(16) AO) == ~ + (#)o(£) -Q +0o(6))z 


Therefore, if — u/c is small and f > 0, then e is at least almost 
an upper bound to the probability that a sum of independent random 
variables each distributed according to [oy + u] ever exceeds f. Inci- 
dentally, since the error term of (14) can have either sign, Z can be 
either larger or smaller than )(6). 

General two-valued lotteries are studied in (de Finetti 1939). 
The simplest possibilities are the symmetric, two-valued lotteries as in 
red-and-black, where e has probability w and —e has probability 
ww = (1 — w) for some positive « and for some win (0, 1). For sucha 9, 
u = w — W, o? = 4wüe?, and I(0) = 2e-2(w-! — w). Finally, when 
w < 1/2, (6) is the positive root of 


(17) we + we = 1; 
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so e‘ = w/w and A = e! log (w/w). If nothing but contractions of 
this 0 are available, U(f) < e = (w/w)/!«. 

As a step in a different problem, Blackwell (1954) extended the 
preceding conclusion by studying, in effect, a gambling house T = Te, 
in which the gambler is confined to a sequence of bets for each of 
which his maximum gain or loss is e and his expected loss is at least a 
fixed fraction p of the most money that has any chance of changing 
hands. Formally for [f + 6] e T(f) it is necessary and sufficient that 
6[ —e’, e’] = 1 for all e’ > «and that u < —pô, where u is the mean of 6 
and ô is the infimum of the ô’ for which 6[— 6’, 6’] = 1. If 6 is con- 
centrated at —e and e with the highest probability w for e compatible 
with the initial constraints of the problem, namely, w = (1 — p)/2, 
then \(6) = e! log ((1 + p)/(1 — p)) = N according to (17); there- 
fore 0 conserves eò” and is available in the \’-exponential house. To 
see that every 0 available in T., is also available in the full house 
under e`, evaluate the Laplace transform of 6, thus. 


(18) L(x) = [=e do(s) 


s [e + e- od — e 
< L, pa + = d6(f) 


cite P os y EP ga 
= 2 


Therefore L(A) < 1 for X < N < (1/8) log [(1 + p)/(1 — p)], and T,.. 
is a subhouse of the -exponential house. Consequently, U(f), the 
optimal probability of reaching the goal 0 from a negative f, is at most 


(19) One (y 


l—p 


This bound is sometimes attained and, when p and e are small, can, 
for all f < 0, be nearly attained by repetition of a two-point lottery. 
The exact nature of the function U(f) is unknown. It is presumably 
singular and possibly related to the red-and-black casino function. 
If the gambler is not permitted to let his fortune descend below —z, 
so that he is in a casinoe, then (8) can be applied to obtain an improved 
bound. The ideas of this paragraph were extended by Weingarten 
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(1956) to asymmetric bounded gambles in an extension of the main 
result of (Blackwell 1954). 

As was mentioned in Section 1.3, a gambler with an initial fortune 
of $1,000 who attempts to attain $10,000 by bets of $1 or less at red- 
and-black is very unlikely to succeed. If he always bets exactly $1, 
with probability w of winning, his probability of attaining his goal is 
exactly 


w 1,000 
> o 
1 


with infinite credit it is 


(21) ey” 
wW 


These formulae derivable from (4), (8), and (17), or by the difference- 
equation approach, have been within the scope of probability theory 
since almost the first decade of the eighteenth century (De Moivre 
1711). For early history of gambler’s-ruin, refer to “De Moivre” in 
the index of (Todhunter 1865). The conclusion of Blackwell in the 
preceding paragraph shows that the gambler cannot help himself by 
sometimes using bets even smaller than $1. 

For a numerical example, substitute w = 9/19—which corre- 
sponds to the version of roulette in Nevada—into (21), and calculate 
a very crude upper bound to the probability of success, thus. 


9,000 9,000 9,000 
(22) (2) = (5) = (1 = 5) < e290 < 19-300. 


With bold play, the gambler can attain his goal with probability 
Q..(1/10), in the notation of Chapter 5. As pointed out in Section 5.2, 
Q.(f) is a rational function of w for each rational f, obtainable by 
repeated application of the functional equations (4.2.1). In particular, 


(23) Q.(1/10) = w4(1 + &)(1 — wd?)-1. 


For w = 9/19, .081 < Q,(1/10) < .082, an improvement over 10-*. 


9 


1. 


2; 


THREE PARTICULAR 
KINDS OF CASINOS 


INTRODUCTION. Each of the three main sections of this 


chapter explores a certain measure of subfairness. 


INCOME-TAX CASINOS 


As a preliminary to his construction of an example of a fair 
lottery that generates a subfair casino, Donald Ornstein found 
that a useful measure of the subfairness of a nontrivial lottery 
with a finite mean is the ratio of the expected value of its positive 
part to that of its negative part. Such a lottery is fair if and 
only if this ratio is 1. Ifa gambler purchases a fair lottery but is 
required to return a fraction t of his winnings to the house—a 
fraction that can be viewed as a tax on winnings or ‘Income’ — 
he has, in effect, purchased a lottery for which the ratio is 1 — #. 
For this reason, 


A w d0(w) 


— W W 


will be called the tax of any lottery 0 for which the fraction is 
well defined. 


Example 1. If 6 is a two-valued lottery that gains 7 and 
loses r with probabilities w and ù, t(@) = 1 — (wř/ūr). 
171 
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Of course, (0) does not exceed 1, and (1) is conveniently rewrit- 
ten as 


(2) (1 — e(6)) f" — wdo(w) = [7 w do(w). 


Clearly, t(0) is positive, zero, or negative according as 0 is subfair, 
fair, or superfair. Only the subfair case is of interest at present. 
Accordingly, for ¢ in (0, 1] the zncome-tax casino T, is the casino in 
which ©,(f) for f > 0 consists of all lotteries 0 on [— f, ©) for which 


(3) (1-1) f" — wdo(w) > f° w dow). 


THEOREM 1. For0 <i < 1, the income-tax casino T, is an inclu- 
sive casino. 


The following theorem and preliminary lemma, which were 
observed by Ornstein, are recorded here with his permission. Let u 
be the usual two-valued utility and U.(f) the probability of reaching 1 
from f under optimal play in the income-tax casino I;. 


LEMMA 1 
(a) T, is leavable and closed under composition. 
(b) U,(f) is the supremum of yu over all y e T.(f). 
(c) For yeET.(f), yu = U.(f) if and only if, for each e> 0, 
yil, 1 + = U(f), v0, à = U(f), and ffl, 1 + 6) = (1 — Dfr10, $). 
(d) fU<f) = (1 — HfUuf). 


THEOREM 2. U.(f) = (f — #f)/(1 — tf). 
In any casino, U(f)/U(f) might be termed the effective odds for 


that casino at f. If U(f)/U(f) = f/f, the odds are fair; only fair 
casinos have fair odds. In the t-income-tax casino, 


that is, the odds are a fixed fraction (1 — t) of the fair odds. 
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COROLLARY 1. y conserves U; in T; at an f in [0, 1] if and only if 


lim y[0, ) +r- ef +) HA- elte = 1, 
and 
f lim (1 —-,gl+e=(1- t)F lim +[0, 0 + e). 


Income-tax casinos have several applications to primitive casinos. 


THEOREM 3. The primitive-casino T», is a subhouse of the income- 
tax casino T, with ¢ = 1 — (wr/wr), for0O <w<r <i. 


In view of Theorem 3, the utility U.,,, of Te,- is majorized by U.. 
In particular, U.,-(r) < U.(r) = w. Since the two-point gamble y, 
vy{1} =w, y{0} = ù, is in I,,-(r), Uy ,(r) > w. The conclusion 
U.,,-(r) = w was derived in Section 6.3 by combinatorial arguments. 
We have not found a noncombinatorial argument showing even that 
Ow (rr?) = w?. 

That bold strategies are optimal for I.,,,—equivalently, that Sw,- 
is U.,,—is not used in the proofs of the following results about S.,,,. 


THEOREM 4. ULF) > Sw-(f) for f in [0, 1], if ¢ = 1 — (wr/itr) 
andif0 <w<r<i1. Equality holds at and only at f = 0,7, and 1. 


Proof: Let o(f) be the bold strategy at f. Since Su, (f) = o(f)u, 
and since (f) is available in I; at f, 


(4) U.(f) = o(f)U: > o(f)u = Surh). 


In view of Corollary 1, the initial gamble of o(f) does not conserve U; 
at f for any f in [0, 1] except f = 0,7, and 1. Therefore, according to 
Corollary 3.3.4, the first inequality in (4) is strict except at 0, 7, 
andl. ¢ 


If the lotteries of two primitive casinos have the same tax, then 
neither primitive casino is more favorable than the other for every 
initial f. 
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COROLLARY 2. If wr/dér = w’?’/w’r’, then neither S,,, nor Sw 
majorizes the other unless both are fair (that is, w = r and w’ = r’) 
or w = w andr = r. 


A phenomenon mentioned in Section 6.7 is exhibited immediately 
following this lemma, which is implied by Theorem 7.3.2. 


LEMMA 2. If, on an interval J, Uı and U» are twice differentiable, 
and Ú, and Ú, are both positive or both negative, then T, the full 
house under U, on J, includes T», the full house under U: on J— 
equivalently, U, is excessive for '.—if and only if U./U2 majorizes 
U1/U. 


THEOREM 5. There are pairs of casinos Tı and Tr such that 
U, > Uz and the U of the union of Tı and T; (which must be at least 
U) is not U.. 


Proof: Let T, and T: be the income-tax casino for t = 1/2 and 
the full-house casino under f?. Then U(f) — U2(f) = f(2 — P — f? 
= ff2(2 — f)-1; so U, does majorize U: Since U,(f)/Ui(f) = 
2(2 — f)-! and U.(f)/U2(f) = f, U2/Ue does not majorize Ü,/ Ù.. 
Lemma 2 now implies that U, is not excessive for the full house under 
f?, and it is therefore not the U of any T which includes that full house 
(Theorem 2.14.1). œ% 


In view of Theorem 2, the linear fractional transformations U; 
satisfy the casino inequality (4.2.1) (as was asserted after (4.6.7) in 
slightly different notation). 

The full houses under the casino functions U; are not casinos, as is 
easily seen with the help of Theorem 8.5.1. 

The income-tax casinos are permitted houses. This suggests an 
approach different from Lemma 1 to the calculation of U, and illus- 
trates the use of Theorem 7.5.2. Consider D = D; the dog-leg function 
of slope ratto 1 — t, where 


_ fg for g = 0, 
9) PO) e — üg forg <0. 


The income-tax casino I, is easily seen to be the house permitted 
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by the family 


(6) vs(g) = Dg — P). 
For each f in [0, 1] let 
(7) wy = alf)vs + O(f), 


where a(f) and b(f) are such that w,(0) = 0 and w;(1) = 1. Accord- 
ing to elementary computation, 


1 
(8) af) = 
f-t 
(9) oN) = 


Since b is convex in f for f < 1, and the graph of each w; is a polygon 
inscribed in that of b, b < wy for all f. Therefore, according to 
Theorem 7.5.2, b is excessive for the income-tax casino T,. Of course b 
is at least u, and Theorem 2.12.1 implies that b is at least U;. Since, 
for each f in [0, 1], there is a two-point y e I,(f) carried by the points 0 
and 1 for which y{1} = yw; = b(f), b(f) < U(f). All in all, b(f) = 
U.(f) for 0 < f < 1, which has already been reported in Theorem 1. 

More generally, Theorem 7.5.6 (or the more detailed Theorem 
7.3.4 on which it is based) provides an avenue for solving the gambling 
problem defined by T, and a general u. 

The gambler cannot diminish the tax by changing the scale of 
a lottery or by buying several lotteries simultaneously : 


LEMMA 3. For any positive number a and subfair random vari- 
able z, the tax of az equals that of z. The tax of the sum of subfair 
random variables is at least the minimum of their taxes. 


Proof: The first assertion is obvious from the definition of tax. 
The second follows from the easy inequality 


(10) DAf + 9) < D(f) + Dig). + 
THEOREM 6. Ifa, - > - , a, are positive numbers and 21, © °° , Za 
are subfair random variables, then the tax of azı + ` `- + Gnén 


is at least the minimum of the taxes of the 2;. 
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The analogue of even the first part of Lemma 3 is true neither 
for the inequity nor for the critical \ of Section 8.7, but the second 
part of Lemma 3 does apply to these measures of subfairness if zı and 
z are independent. 


3. THE CASINO THAT TAKES 
A CUT OF THE STAKE 


Whenever people talk about a lottery or other game of “pure 
chance”, like a specific bet at roulette, they are apt to take for granted 
that the measure of subfairness of the lottery to the customer and of its 
profitability to the house is what we shall here call the cut. The stake 
of a lottery 6 is the (essential) supremum of the losses under 9, that is, 
the infimum of the nonnegative numbers s for which @[—s, ©) = 1. 
If 6 has positive stake s and is subfair, the cut c is the ratio of the 
negative of the mean m of 0 to the stake. In these terms, the purchase 
of a lottery ticket (or insurance policy) of price (or premium) s can 
be envisaged thus. A fraction of s, the cut (or loading), is paid by the 
gambler as a fee to the house (or insurance company); he is paid back 
according to the fair lottery 6 — m = 0 + sc. 

The cut of a lottery (or the loading of a policy) may be a parameter 
of economic importance in some contexts. Two easy facts suggestive 
of such importance are that the analogue of Theorem 2.6 applies to the 
cut as well as to the tax and that the tax of a lottery cannot be less 
than the cut. These facts, especially the former, may be largely 
responsible for the widespread feeling that the cut cannot be reduced 
by means of some policy; see, for example, (Scarne 1961, p. 385). 
Nevertheless, when the gambler can buy lotteries consecutively, each 
in the light of the outcome of the last, he may be able to construct 
lotteries of arbitrarily low cut from lotteries of cut arbitrarily close to 1. 


Example 1. In a subfair primitive casino characterized by w 
and r, the cut of all available lotteries (aside from 6(0)) is c = 
(ür — wr)/r = (r — w)/r = 1 — (w/r). A gambler whose initial 
fortune is 1 — 7* and who plays boldly constructs for himself, in n 
moves, a simple lottery with r’ = 1 — 7”, w = 1 — w” (Section 
6.2). The cut of this constructed lottery is (r’ — w’)/r’ = 
(ür — 7*)/(1 — 7"), which approaches 0 in n. Similarly, the 
gambler in the primitive casino who starts at r” must construct 
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for himself a lottery with the large cut 1 — (w/r)* if he is to play 
optimally. 


Example 2. In any subfair casino with continuous U, the gam- 
bler who uses a nearly optimal policy beginning at f in (0, 1) 
constructs for himself a lottery of cut scarcely larger than 
1 — (U(f)/f), which is arbitrarily small for f near 1. 


Example 3. The theory of uniform roulette (Section 6.9) led to 
the interesting example of two casinos in which all gambles have 
the same cut 1 — (w/r) but with the casino function of one 
strictly larger than that of the other throughout (0, 1), which 
contrasts with Corollary 2.2. 


Though the minimum cut of lotteries directly offered by a gam- 
bling house does not ordinarily apply to lotteries that the gambler 
can construct for himself within the gambling house, it does express 
some constraint on what the gambler (with limited funds) can do. 
Any subfair gambling house on [0, œ), the lotteries of which have 
cut at least c, is a subhouse of the casino in which each @(f) consists 
of all lotteries 0 on [—f, ) that are not superfair and for which 
c(@) > c if s(@) > 0. Therefore the U of this casino, the casino that 
takes a cut of c, gives an upper bound of the probability of attaining 1 
from an initial fortune in any such gambling house. The main object 
of this section is to calculate U. 

Of course, if a simple lottery of cut c and stake s leads from f < 1 
to 1 with probability w, then 


_ d— os, ._ ftes 
(1) wW “Fp Ù FFs 


If a gambler at f plays boldly, staking f on such a lottery, w = f — of, 
which is obviously poor for f near 1. It is easy to find better strategies. 
Trial and error suggest that a very good one is to stake (1/n)th of 
the initial fortune f (if f < 1) on a simple lottery of cut c that leads to 1 
with probability wı and to (n — 1)f/n with probability w, for some 
large integer n. Then if this gamble does not attain the goal, f/n 
is staked again with cut c and with probability we of attaining the goal 
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and probability w,. of falling to (n — 2)f/n, continuing until the goal 


is attained or the fortune 0 is reached. The successive fortunes, if 
the goal is not attained, are f: = (n — 1)f/n (1 < i < n), and 


(2) WwW: = ais =° 


The logarithm of the probability that the goal is not attained with 
this strategy is 


(3) Ñ tog E EA y wi + X olw) 


= €logf + o(1). 


Therefore the probability of attaining the goal with this strategy is, 
for large n, about 


(4) 1 — (1 — f) 9, 


Many other strategies, and even stationary families of strategies, are 
about as good; for example, the f; can be replaced by any descending 
sequence, with very small steps, that reaches, or converges to, 0. 
Since (4) can nearly be attained, U majorizes the function W given by 
(4) forf < land equal to 1 forf > 1. It will next be shown by means 
of the basic Theorem 2.12.1 that W majorizes U and therefore is U. 

To see that W > U, the only nontrivial step is to verify that 
yW < W(f) for y ET(f) and fe (0,1). If sis the stake of y, then 
y is (all but) carried on the interval [f — s, ©), and the function 
W is majorized there by the linear function L for which L(f — s) = 
W(f — s)and L(1) = W(1) = 1. Therefore, yW < yL < L(f) minus 
cs times the slope of L, or L(f — s) plus (s — cs) times the slope of L. 
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Analytically, 

Ln =s) 
= W(f—s)+sW(f-s) 
< Wf), 


(5) yW <W(f-—s)+sl—e 


where the final inequality follows from the strict convexity of (4) for c 
in (0,1). Therefore W > U. 


Figure 1 Illustration of (5) with f = .75, c = .4, s = .25. 


THEOREM 1. There is at each fin T. a stationary optimal strategy, 
and yet no stationary family of optimal strategies is available. 
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Proof: For f in (0, 1), let oo be diffuse on f — n—. Let o,[f’] 
be stationary and n—!-optimal for f’ = f — n-!. The ø thus deter- 
mined is optimal at f. 

Nonetheless, if ~(f) determined a stationary family of optimal 
strategies, then U(f) = v(f)U (according to (3.3.1)); so the inequality 
(5) implies that the stake of y(f) is necessarily 0, that is, y(f) is trivial. 
Since u is excessive for y(f) and u > u, Theorem 2.12.1 implies that 
u > U, which is a contradiction. ¢ 


According to (5), no y in T.(f) other than 6(f), which is countably 
additive on the Borel sets or even on the intervals, conserves U, at f. 
Corollary 3.3.4 therefore implies the nonexistence of optimal strategies 
that employ only countably additive gambles. Time-continuous 
reformulations of the problem can be suggested in which there are 
such optimal strategies and even stationary families of optimal 
strategies. 

The effective cut corresponding to U(f) is 


UN) _P-7 1-9-7 _ 


(6) cf) =1- F ro 7 


C, 


which reflects the obvious fact that the gambler has no incentive in T 
to construct for himself gambles of cut as large as c. According to (6), 
c(f) is nearly as large as c for very small f. So if the gambler’s objec- 
tive is to increase his fortune manyfold, c is approximately a direct 
measure of the subfairness of r. The fraction ¢ of the cut that is 
effective under optimal play, namely, c(f)/c, is defined on the square 
0<f<1,0<c <1 and is decreasing in f and increasing inc. It 
extends to a continuous function on the closed unit square except 
for the corner (1, 1), where its value is indeterminate and where ¢(f, c) 
behaves like fê. Clearly, ¢(f, 1) = 1, ¢(1,c) = 0, and L’Hospital’s 
rule gives ¢(0, c) = land ¢(f,0) = — (f/f) log f. Some contours of ¢ 
are shown in Fig. 2. 

The casino that takes a cut of c has a natural dual, the casino gen- 
erated by all subfair bounded lotteries 6 for which a cut of at least c/é 
is taken from the (essential) supremum of the gains; that 1s, 


(7) —m(6) > (G) sup 0. 
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Fortune f —— 


Figure 2 Contours of ¢. 


The demonstrations of various facts about this dual of the casino 
that takes a cut of the stake are too similar to corresponding ones 
about the original casino to be repeated explicitly. Here a typical 
attractive gamble is to stake the whole of f, for f in (0, 1), on a high 
probability of inching forward a bit. The U of this casino is the dual 
of the U of the casino that takes a cut c of the stake, namely, f". 
These casino functions were encountered near the end of Section 8.6 
as the casino functions of the only subfair, rich man’s casinos that are 
full houses. 

As Lawrence Jackson helped us see, this section has implications 
for primitive casino functions. Since every nontrivial lottery in the 
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subfair primitive casino I,,z, has the cut c = 1 — (w/r), 
(8) Stvtr(f) <1 (1 = f) ae 


Moreover, for ¢ sufficiently close to 0, there are strategies available in 


Pwt that are nearly optimal for the casino that takes a cut c of the 
stake. Consequently, 


(9) lim Sote) = 1 — (1 — ff), 


uniformly in f. As a corollary, the continuous uniform-roulette table, 
namely, 


(10) U Tajir 


has (4) for its U. 
Dually, f!/¢ is also the uniform limit of primitive casino functions. 
Except for these two one-parameter families, the trivial U, and 
the two-parameter family of primitive casino functions themselves, 
no function is a limit of primitive casino functions, as is not hard to see. 


4. HOUSES OF INEQUITY 


In Section 8.7 the inequity of a lottery 6, that is, I(0) = —2y/c?, 
was seen to be an index of the undesirability of 6 in that J(@) often 
approximates the exponential measure of subfairness \(@). This sec- 
tion shows exactly how great a limitation a given inequity imposes. 


THEOREM 1. Suppose that for some positive constant a every 
available lottery 0 is such that 


(1) a f zd(6) > a | 2? d6(z) 


or even only such that the ratio of the negative of the mean to the 
variance (that is, 3I(@)) is at least a, then under any policy for which 
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the probability of losing more than Zis 0, the probability of gaining g 
is at most 


l 1 
2 pee Soe 
(2) g+l ltag 


This bound can nearly be attained by a succession of two-valued 
lotteries each of which has a very small stake and a positive probability 
of reaching the goal. 


Proof: It is not difficult to see, say by an argument like one given 
in Section 3, that the goal is nearly attained in the manner specified 
with lotteries that satisfy (1) with equality. Since the condition 
— u/c? > a is plainly less severe than condition (1), all that remains 
s to establish that (2) is a bound under the condition —y/o? > a. 

It suffices to show, for the casinoe where 


O(f) = {0: I(@) > 2a, [—f, ©) = 1} 


with u the indicator of [t, ©) for arbitrary positive t, that U is major- 
ized by Q, where 


_ J = tn 0 << 
(3) Q(f) = (a + a(t — f)] or0Sf St 
l fri <f < o. 


For f < tlet R; be the quadratic function whose graph is tangent 


to the graph of Q at the point (f, Q(f)) and for which R;(t) = 1. As 
is easily verified, 


(4) Rs(f +2) = Q) + O/)(@ + ax’), 
and as is less easy to verify, 
(5) QG +x) < Rf +z) torftr20. 


If y is a gamble available at f + A with mean f and variance o?, 
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then 

(6) YQ < yR; = Q(f) + a0?Q(f) 
< Qf) + AQ(s) 
<Qf+A4). + 


The especially simple and interesting limiting case of Theorem 
1 with l = — œ was emphasized in (Dubins and Savage 1965) and 


applied in (Dubins and Freedman 1965). 
What bound replaces (2) if “variance” is replaced by “standard 


deviation” in the hypothesis of Theorem 1? 


10 


ONE-LOTTERY 
STRATEGIES 


1. INTRODUCTION. This chapter is basically an application 


of part of the familiar theory of sums of independent and iden- 
tically distributed random variables. 

A casino T has a superfair lottery 0 available at 1 if and only 
if T is superfair; equivalently, if and only if, for the usual u, U is 
the indicator of (0, ©). The proof of this in Section 4.4 is 
indirect; so there is some interest in finding a stationary family 
of optimal strategies based on 6. One natural possibility, the 
6-proportional family, is always to use [f0 + f] for f < 1 and 
5(f) for f > 1, that is, to use 6 in proportion to your wealth 
until the goal is achieved. Somewhat surprisingly, this is not 
always optimal, even for quite ordinary lotteries 6. What is 
needed for it to be optimal is roughly that f log (1 + z) d6(z) = 0; 
when this integral is undefined, the -proportional family may 
or may not be optimal. Though the integral can be negative 
for 6 itself, it is bound to be positive for the contraction [s6] for 
sufficiently small positive s; so the [sé]-proportional family is 
optimal for small s. This result, the main one of this chapter, 
will be used as two technical points in the next chapter. 

Those who do not wish to enter into the formal proof and 
the refinements of the preceding paragraph can skip or skim 
this chapter. 

To replace multiplication by addition and to take advantage 
of the established theory of sums of independent and identically 
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distributed random variables, study of proportional families will be 
founded upon that of translational families, defined as follows: 
If ¢ is a lottery on [— ©, œ), the ¢-translational family of strategies & 
is the family of strategies generated by the gambles ¢(f) = [¢ + f] if 
f < Oand é(f) iff > 0. Itisto be understood that ¢(— œ) = [ġ — œ] 
= ô(— œ). The utility u of interest now and until Section 5 is the 
indicator of [0, ©), and the main question, which we cannot—and 
need not—answer completely, is “For which ¢ is u(¢(f)) = 1 for all 
f > — 00 aed 

For a useful reformulation, consider the gambling house I, for 
which I',(f) consists only of [¢ + f]. This house is leavable only in 
the trivial case that ¢ = 6(0). It has only one strategy available at 
each f; this stationary family o* is the family generated by ¢*(f) = 
[ġ + f] at all fin [~ ©, œ). 


THEOREM 1. a(f) is an optimal strategy at f of T4, the leavable 
closure of T4; u(a) is the U of T% and of Ty. 


Proof: The two assertions are plainly equivalent to each other. 
The first is an instance of Theorem 3.9.5, the proof of which we did 
not give. But the second is easily proved directly, thus: Plainly, 
u(é) majorizes u. According to Theorem 3.2.1, ¢(f)u(a) = u(a(f)); 
the basic Theorem 2.12.1 now applies. 


2. LIMITED PLAYING TIME 


Let Um (m = 0,1, - - > , w) be defined for Tž as in Section 2.15. 
It will ultimately be shown that U of Pg and Ty is U.. All these func- 
tions are plainly 1 for f > 0. 


LEMMA 1. u(a(f), t) is nondecreasing in the stop rule ż. 
Proof: Apply Theorem 3.4.7. 


LEMMA 2. U,(f) = u(@(f), m). 


LEMMA 3. For0 < m < ov, 


Um(f) = o*(f) th: max (F, fi, ++ + fm) Z 1}. 


The next two lemmas are instances of Theorem 8.2.4 and of 
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(8.3.1), (8.3.2), and (8.3.3), except for the minor detail that — © was 
not included as a fortune there. 


LEMMA 4. Um(f), U(f), and U(f) are nondecreasing in m and 
inffor0 <m<wand —~ <f< œ. 


LEMMA 5. Unin(f + 9) > Un(f)U.(g), ULF + 9) > U.(f)U.(Q), 
and U(f + g) > U(f)U(g) for0 < m < wand —œ <f,g< œ. 


LEMMA 6. U.(nf) > UG(f), and U(nf) > U(f). 


THEOREM 1. JU. (f) = 1 either for all f in (— ~,0) or for none; 
similarly for U(f). 


THEOREM 2. U>(f) is the indicator of [0, ©), U(f) = ¢[-f, œ] 
for f < 0, and more generally, 


J Unig +f)dd(g)  forf< o0, 


(1) Um+(f) = | 
1 for f > 0. 


3. CONVENTIONAL LOTTERIES 


If the lottery ¢ that generates o* is conventional, that is, count- 
ably additive on the Borel sets of [— ©, œ), then the distribution of 


(fı © © * ,fm) under o* on the Borel sets of the m-fold Cartesian 
product of [~ ©, œ) is the same as that of (f + s, © © © ,f + Sm), 
where 


(1) Sm = 


-M13 
S 


and the y; are random variables independently distributed according 
to ¢. 

The inclusion of — œ as a possible value of y; (to provide a log- 
arithm for 0) is a little unusual but not unheard of. The reader will 
easily see that it does not interfere. 

When ¢ is conventional, Un(f) is the probability that at least 
one of the partial sums 0, si, - > * , Sm is as large as —f, according to 
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Lemma 2.3. And, in conventional terms, U.(f) is the probability 
that 0 or some s, is as large as —f. Thus, much of the literature on 
sums like the s, can be brought to bear. In the last decade there 
have been studies of U(f) and U,.(f) for conventional ¢ that go far 
beyond what is needed in this book. A central work in this literature 
is (Spitzer 1956). Theorem 4.1 of that paper includes the following 
lemma. You may find the alternative demonstration presented below 
interesting or convenient. 


LEMMA 1. lim sup sa is a constant almost surely. This constant 
can be only œ, 0, or — œ. It is 0 if and only if y; = 0 almost surely; 
it is œ (— œ) if and only if sup sn > 0 (inf s, < 0) almost surely. 


Proof: Apply a variant of the zero-one law (Hewitt and Sav- 
age 1955, Theorem 11.3) to see that lim sup s, is some constant c 
almost surely. Suppose 0<c< æ. Some s, is almost sure to 
exceed c/2; let nı be the first n for which this happens. Then some 
S, = Snn — Sa, is almost sure to exceed c/2, since the s, have the 
same distribution as the s, (Doob 1953, p. 145). Proceeding in this 
way, construct S:,, Snin., © © © converging to œ. Therefore lim sup s, 
= œ, contradicting the assumption 0 < c < œ. Likewise, — œ <c 
< 0 is impossible. As is not difficult to show, if c = 0, then y; = 0 
almost surely. @ 


LEMMA 2. For a conventional ¢, U(f) = 1 for —œ <f <0 if 
and only if lim sup s, = © almost surely, or, equivalently, if and 
only if sup s, > 0 almost surely. Otherwise, U.(f) < 1 for —œ <f 
< 0, and s, = 0 for all n almost surely or s, converges to — © almost 
surely. 


Proof: Apply Lemma 1 and the above remark that U.(f) is the 
conventional probability that 0 or some s, is at least —f. ¢ 


Theorems 1, 2, and 3 will be proved in this section for conventional 
lotteries only. But the proofs will be extended to all lotteries in the 
next section. 


THEOREM 1. If U(f) < lfor—» <f <0, then U,(f) converges 
uniformly to U,(f). 


Proof: For f>0, U,(f) = U.(f) =1. For f <0, U.(f) — 
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U,(f) is the probability that, for some m > n, but for no m < n, 
Sm > —f. This is at most the probability that, for some m > n, 
Sm > 0, which approaches zero inn. @ 


THEOREM 2. U = U.. 


Proof: The conclusion is obvious if U.(f) = Ifor — œ < f< œ. 
In the other case, it follows immediately from the preceding theorem 
and part (b) of Theorem 2.15.5. ¢ 


Necessary and sufficient conditions on ¢, the distribution of y;, 
for lim sup s, to be infinite, that are convenient for this chapter, are 
not known to us. (See, however, (Spitzer 1956, Theorem 4.1).) If 
Ey; is well defined, perhaps infinite, then Kolmogorov’s law of large 
numbers (Loéve 1955, page 423; Doob 1953, page 141) supplemented 
by an interesting theorem of Chung and Fuchs (1951, Theorem 5) 
readily supplies a convenient condition. 


LEMMA 3. If Ey; > 0, sn converges to © almost surely; if Ey; < 0, 
Sn converges to — © almost surely; if Hy; = 0, and y; is not almost 
identically 0, then lim sup sn = © and lim inf s, = — œ almost surely. 
If Ey; and Ey; are both infinite, then lim sup s» can be almost surely © 
and can be almost surely — œ. 


Proof: The discussion above suggests the proof for all except 
the last sentence. If y; has a standard Cauchy distribution, then 


lim sup s: = ©. But if, for example, prob (y; = — œ) > 0, then 
lim sup s, = — œ. @ 

There are also examples with prob (y; = — ©) = 0, By} and Ey; 
both infinite, and lim sup s, = — © (Derman and Robbins 1955). 


THEOREM 3. For each lottery ¢ on [— œ, œ): 

(a) If $(e, ©) = 0 for all positive e, then U(f) = 0 for — œ < 
f<0. 

(b) If (ec, ©) > O for some positive e, and f fd¢(f) > 0, then 
U(f) = 1for—«7 <f<0. 

(c) If ff dd(f) < 0, then U(f) < 1 for —œ <f <0. 

(d) If ffdd(f) is not defined, then either 0 < U(f) < 1 for 
—æ <f<0OorU(f) = 1for—« <f<0. Both cases are possible, 
and the first obtains if ¢{— œ} > 0. 


190 One-lottery strategies [Chap. 10 


Theorem 3 is the main goal of this section. It has been so 
expressed as to make the hypothesis that ¢ is conventional superfluous, 
as will be shown in the next section. 


4. GENERAL LOTTERIES 


This section extends to arbitrary lotteries on [— ©, ©) the main 
conclusions about conventional lotteries in the preceding section. 

One possible peculiarity of a nonconventional ¢ on [— œ, œ) is 
that it can be partially remote, that is, ¢(c, ©) can be uniformly 
positive for finite c. The facts catalogued in the next theorem are 
easy to prove from first principles. 


THEOREM 1. If ¢ is partially remote: 

(a) f f dd(f) is infinite or undefined. 

(b) If ¢{-—~o} = 0, U(f) =1lfor—~ <f<0O. 

(c) If pf{—æ} >0, ffdd(f) is undefined, 0 < U(f) < 1 for 
— æ < f < 0, and Un converges uniformly to U. 


In harmony with Section 4.5, two lotteries ¢ and ¢’ are companions 
if gv = ¢’v for every v bounded and continuous on F, which here is the 
whole of [— 0, ©). This concept admits of wide topological general- 
ization, and much of this section can be correspondingly generalized. 
It will soon be clear that, at least for the purposes of this chapter, a 
pair of companions really are very much alike. On this account, 
Lemma 2 below reduces the general situation nearly to that for con- 
ventional gambles. 


LEMMA 1. The not partially remote lotteries, ¢ and ¢’, are com- 
panions if and only if ¢(f — «e ~) > ọ'(f, œ) and ọ'(f— «e œ) > 
(f, ©) for all f in (— ©, œ) and all positive e. 


Proof: Let v be any continuous function bounded between 0 
and 1, with v(g) = lforg > f and v(g) = O forg < (f — «). If and 
¢’ are companions, ¢(f — «, ©) > gv = dv > ¢'(f, ©). This proves 
the “only if” clause. 

If o(f — e œ) > (f, œ) and o(f — «e ~) = (f, ~) for all f 
in (— ©, œ) and all positive e, it is easy to see that gv = ¢’v for every 
bounded, continuous, monotonic v. Therefore, dv = ¢’v if v is con- 
tinuous and of bounded variation on [— ©, œ) or is the uniform limit 
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of such functions. If v is any function bounded and continuous on 
[— œ, œ), let v.(f) = v(f) for f < c and v.(f) = v(c) for f > c. Then 
gv. = $v., and since ¢ and @’ are not partially remote, lim ve = gv 
and lim ¢’v, = ¢/v. ¢ẹ 


LEMMA 2. Every not partially remote ¢ has one and only one 
conventional companion ¢*, and ¢* is characterized by the condition 
that 


(1) ¢*(f, ©) = sup o(g, ©). 
g>f 


Proof: Plainly (1) does define a conventional ¢*. In view 
of (1), e*(f — e, ©) = o(f, œ); 


(f — €, 00 ) 2 ¢o*(f — €, 00 ) = ¢*(f, 00 ) ; 


so Lemma 1 applies to show that ¢ and ¢* are companions. Lemma 1 
shows also that distinct conventional lotteries cannot be compan- 
ions. @ 


LEMMA 3. If ¢ and ¢’ are companions, then f f d¢(f) = f f d¢’(f) 
if either integral is defined. 


A pair of bounded, nondecreasing functions V and V’ on[— œ, œ) 
are companions if V(f + e) > V’(f) and V’(f + © > V(f) for all f in 
[— œ, œ) and all positive e. 


LEMMA 4. V and V’ are companions if and only if they have the 
same points of continuity and agree with each other there and at — œ. 


LEMMA 5. If V, approaches V and V; approaches V’, and if V, 
and V, are companions for each n, then V and V’ are companions. 
If, further, V, approaches V uniformly, then Vi, approaches V’ 
uniformly. 


Proof: To see that V and V’ are companions, calculate thus for 
fixed f, «e, and ô and for sufficiently large n: V(f + €) >V,(f+. —6=> 
Vif) — 6 > V'(f) — 26. 

If V, approaches V uniformly, then, in view of Lemma 4, V; 
approaches V’ uniformly on the set of those fortunes that are points 
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of continuity of V’ and of every V,. Let G be the denumerable set of 
fortunes not covered by this conclusion. For any 6 there are only a 
finite number of elements of G where the magnitude of the discontinuity 
of V’ is as great as ô. ¢ 


LEMMA 6. If V and V’ are companions and ¢ and ¢’ are com- 
panions, then the functions of f defined by f V(f +g) d¢(g) and 
S V'(f + g) dd’(g) are companions. 


Proof: 


[ VE +2 + 9) dog) = [VF + e+ 9) dolo) 
= | V'S + 9) dio + 409) 
> | VE +9) deg). + 


Let U,, U., and U be defined for ¢ as in Section 2, and let U, 
and U., = U be the corresponding functions for the conventional com- 
panion ¢ of ¢. 


LEMMA 7. U, and 0,, and U, and U,, are companions. Both 
U., and U., are identically 1 in (— œ, 0), or both are less than 1 there. 
If U. is less than 1 in (— œ, 0), then U, converges uniformly to U... 
In either case, U» = U, and U and U are companions. 


Proof: Lemma 6 and Theorem 2.2 show that U, and U, are 
companions. Lemma 5 then shows that U., and U., are companions, 
which implies that both are 1 in (— œ, 0) or neither is. The assertion 
about uniform convergence follows from Theorem 3.1 and the last 
sentence of Lemma 5. The final assertion is now an application of 
part (b) of Theorem 2.15.5. ¢ 


Lemma 7 contains Theorems 3.1 and 3.2 without the hypothesis 
that ¢~ is conventional. Since the central Theorem 3.3 without the 
hypothesis that ¢ is conventional is a corollary of Lemmas 3 and 7, 
the objectives of this section have been attained. 


5. PROPORTIONAL STRATEGIES 


Let u(@)(f) be the utility of the -proportional strategy initiat- 
ing at f in [0, œ), and let ¢ be the lottery on [— ©, œ) such that 
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@ log (A + 1) = 6A for every A C [—1, ©). Then u(6)(f) is the 
utility of the ¢-translational strategy initiating at logf. Through 
the final paragraph of Section 4, this observation leads to the following 
conclusions. 


THEOREM 1. If f=0, u(@)(f) =0. TIff>1, u(@(f) = 1. One 
of the following cases applies for all f in (0, 1) and each can occur: 

(a) 6(e, ©) = 0 for all positive «e, and u(6)(f) = 0. 

(b) O(c, ©) > 0 for some positive e, f log (1 + x) d@(x) < 0, and 
0 < u(A(f) < 1. 

(c) (ce, ©) >O for some positive e, flog (1 + x) dé(x) > 0, 
u(@)(f) = 1. 

(d) flog (1 + x) d6(z) is undefined, and u(6)(f) = 1. 

(d') flog (1 + x) d(x) is undefined, and 0 < u(@)(f) < 1. 


On [—1, ©), m(@) = f x d@(z) is, of course, defined for all 6. If 
m(6) < 0, 8 is at most fair, and cases (a) and (b) of Theorem 1 are the 
actual possibilities. If m(6) > 0, case (a) is excluded, but all the 
others are possible, as examples will soon show. 

Thus, even if 0 is superfair, the 6-proportional strategies may have 
probability less than 1 of attaining the goal 1 from every fortune f in 
(0,1). Nonetheless, for sufficiently small positive s the [s6]-propor- 
tional strategies do attain the goal with probability 1 from every 
positive fortune if 6 is superfair. Letting 


(1) B(s) = J log (1 + zx) d[s6](z) 


= f log (1 + sz) do(z), 


it will in fact be shown that B(s) > 0, so that case (c) obtains for [s8], 
for all sufficiently small positive s if 0 is superfair. 


THEOREM 2. For every 0 on [—1, œ) with f x d(x) > 0, B(s) is 
defined for s in [0, 1). It isOfors=0. Either B(s) = œ for all s 
in (0, 1) or B(s) < œ and is concave for s in [0, 1), and B’(0) > 0. 
B(s) is positive for sufficiently small s. The following cases, and only 
these, can occur: 
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1. B(s) < œ in (0, 1]. 
1.1. B(s) > 0 in (0, 1). 
1.2. For a unique so in (0,1), B(s) > O in (0, so), B(s) = 0, 
and B(s) < 0 in (so, 1]. 

2. B(s) = « for all s in (0, 1). 


2.1. B(1) = œ. 
2.2. B(1) is undefined. 
2.2.1. u(@) = 1. 


2.2.2. 0 < u(6)(f) < 1 for f in (0, 1). 
Both subcases of case 1 are compatible both with f x d@(x) < œ 
and with f x d6(x) = ©, but case 2 is compatible only with f x d6(z) 


= ©, 


Proof: Since log (1 + sz) > log (1 — s), B(s) is defined and is at 
least log (1 — s) in [0, 1), and B(0) is obviously 0. 

Since, for s and s’ in (0, 1), log (1 + sz) — log (1 + s’z) is bounded 
for x in[—1, <), B(s) is either infinite for all s in (0, 1) or for none. 
If the first of these possibilities obtains, l ” log (1 + x) d0(z) = œ, 


and cases 2.1 and 2.2 are the only ones possible. Since 
sx > log (1 + sz), 


these cases cannot occur unless f x d6(z) = œ. 

If B(s) is finite in [0, 1), then, according to the usual techniques, 
B(s) has two derivatives in s for s in [0, 1) that are computable by 
differentiation under the expectation sign. It is seen thus that B is 
concave in s for s in [0, 1) and, since @ is superfair, B(0) > 0. Also, 
B(O) = 0. Since, for sin (0, 1), log (1 + x) — log (1 + sz) is bounded 
for x > 0, h ” log (1 + x) d6(x) < œ; so B(1) is well defined though 


possibly — œ. Also, 
(2) h log (1 + x) d0(z) = lim Í, ” log (1 + sx) d6(z), 


because log (1 + sx) approaches log (1 + zx) uniformly in z > 0. By 
a slightly different but equally easy argument, 


(3) l, log (1 + 2) d0(z) = lim l, log (1 + sz) d6(z). 
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So B(s) approaches B(1) as s approaches 1. Putting these facts 
together, B(s) is positive for sufficiently small positive s, and if it is 
not positive for all s in (0,1) (case 1.1), it has a unique zero so as 
required by case 1.2. 

It has thus been shown that one of the five mutually exclusive 
eases 1.1, 1.2, 2.1, 2.2.1, or 2.2.2 must obtain. Examples will now 
show that these cases are all possible and will illustrate some other 
phenomena. 


Example 1. 6 is uniform on [—1, g + 1] for some positive g. 
+1 
(4) o > f xdo(x) = g +2) f” de = 2>0. 


B(1) = f log (1 + x) d@(x) = log (g + 2) — 1. This can be pos- 
itive, 0, or negative, illustrating both parts of case 1 with f 6 d6(z) 
<. 


Example 2. @ is a convex combination of the uniform distribu- 
bution on [—1,0] and a distribution on (0, ©) with density 
A(1 + x)-! for some à in (0,1). Thus @ has density b on 
[—1, 0) and density 6\(1 + x)-}— on (0, ©) for some b in (0, 1). 


(5) B) =b te log (1 + z) dx 
+ br 5 (1 + z) log (1 + x) dz < œ. 


Manipulating b for any fixed à illustrates both parts of case 1 
again, this time with f z d@(xz) = œ. 


Example 3. Paralleling the proof of Lemma 3.3, let 0 be the 
distribution of e” — 1 for a random variable y with E max (0, y) 
= ©; so B(1) = Ey is œ% or is undefined. For any such 9, 
case 1 does not obtain. If B(1) = œ, it is case 2.1 that does. 
If B(1) is undefined, then, according to part (d) of Theorem 3.4, 
either of the two remaining subcases can occur. ¢ 


THEOREM 3. If I is a casino with a superfair lottery 0 available 
at 1, then T is superfair, U(f) = 1 for f > 0, and the [s6]-proportional 
family of strategies is optimal for all sufficiently small positive s. 
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Proof: According to Theorem 2, B(s) = f log (1 + zx) d[s6](z) 
> 0 for sufficiently small s > 0; so, according to part (c) of Theorem 1, 
u([sé])(f) = 1 for fin (0,1). ¢ 


Even if every expected gain and every expected fortune f, is 
infinite, the fortunes f, can converge to 0 if you repeatedly stake too 
large a fraction of your fortune, as Example 2 illustrates. 

An example of some interest is a superfair simple lottery, that is, 
a lottery under which the gambler either gains g with probability w 
or loses | with probability w#, where wg > wl. Here 


B(s) = f log (1 + sz) d0(z) = wlog (1 + sg) + log (1 — sl), 


and B(1), of course, is w log (1 + g) + wlog (1 — 1). Ina primitive 
casino, l = 1, and B(1) = — œ. Therefore, in a superfair primitive 
casino, it is imprudent to stake a large share of your fortune repeatedly. 
Even if0 < l < 1, wand g can beso manipulated as to ensure f x d6(z) 
> 0 and B(1) < 0. 

It is not to be expected that the root so of the equation B(s) = 0 
can be calculated explicitly in terms of w, g, and l. However, a stake s 
less than so can easily be found for a simple superfair 6. An ele- 
mentary differentiation gives B’(s) = wg(1 + sg)—! — wi(1 — sl)—. 
Solving B’(s) = 0 gives s’ = (wg — wl)/gl. For s, the minimum of s’ 
and 1, the [s6]-proportional strategies attain the goal with probability 1 
from every fo > 0. 

How does the expected number of gambles E(N|f, s, 6) required 
to attain the goal from a given f in (0, 1) depend on s for s in (0, so, 
presuming the expected number is finite? Breiman (1961) has found 
results along these lines. We ourselves know little about the depend- 
ence of this function on s, but it seems implausible that it should not 
have discontinuities if, for example, @ is two-valued and superfair. 
The function is not always monotonic, for according to a well-known 
theorem of Wald and Blackwell (Blackwell 1946; Doob 1958, p. 351), 
the expectation is large near s = 0 and, if there is an so, near so. 

When B(s) < 0, the dependence on s of the probability u([s6])(f) 
of attaining the goal 1 would also be of interest. This function can 
easily be discontinuous, but perhaps it must be nonincreasing in s. 


11 
FAIR CASINOS 


1. INTRODUCTION. This chapter determines when a casino T 
is fair, that is, such that U(f) = fin (0,1). Itis necessary that T 
contain no superfair lottery (Section 4.4 and Theorem 10.5.3); in 
the presence of this condition, T is fair if and only if it is at least 
fair, that is, if and only if U(f) > f for all f—or, equivalently, for 
some f—in (0, 1). 

Suppose @(1) contains no superfair lottery but does contain 
a fair nontrivial 6. If @ has bounded support, then it is easy to 
show that T is fair. But what if 0 does not have bounded sup- 
port? That a lottery can generate a fair casino though it has 
no bounded support was seen in Section 4.4. Donald Ornstein 
showed us, in the spring of 1958, that a fair lottery can generate 
an arbitrarily subfair casino. Therefore, some fair lotteries 
generate fair casinos, and others generate subfair casinos. 

Which do which? For 6 to generate a fair casino it is 
necessary and sufficient that 


(1) i w do(w) = 0, C, lw] de(w) > 0, 


and 


—z |° wado 
iy wn Pda 
a2 i, w? d0(w) 


A main purpose of this chapter is to prove this (Theorem 6.1). 
Another is to find necessary and sufficient conditions for any 
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casino, not only one generated by a single lottery, to be fair (Theorem 
3.1 and Theorem 3.2). 


2. FAIR LOTTERIES CAN GENERATE SUBFAIR 
CASINOS. 


This section demonstrates Donald Ornstein’s conclusion that 
some fair lotteries generate arbitrarily subfair casinos, but by a method 
different from the one used by him. This conclusion will not be 
formally relied on later, so this section could be read only casually. 

Let yo be a fixed gamble and To the smallest casino for which 
yo ETo(1). Thus, To(f) = {[fsyo + fs]: OS s< 1}. If Q is any 
nonnegative function that is fairly regular, increasing on [0, 1], and 
equal to 1 on [1, ©), it will prove possible to choose yo fair and yet 
such that yQ < Q(f) for all f and all yinT)(f). According to Theorem 
2.12.1, this implies that Q majorizes U; so To is subfair if Q also satisfies 
Q(f) < f for some f in (0, 1). 

Specifically, let Q restricted to [0, 1] have the following properties: 
(a) Q(f) => 0 and Q(1) = 1; (6) Q(f) > a> 0 for some a; (c) Q(f) 
< 2a8 for some 8 > 0. Such functions exist in abundance. In fact, 
Q(f’) can be arbitrarily small for any f’ in (0, 1). Consider, for exam- 
ple, Q(f) = e'" for f in [0, 1] with O < e < 1. 

As one preliminary to deriving an upper bound for yQ, note that, 
for f and f + g in (0, 1], 


(1) Qf + 9) < Qf) + gQ(f) + gab. 


Also, since Q(1) < ~, Q(f)/f is a bounded function of f; that is, for 
all f in [0, 1], 


Q(f) 
2 tv! cay 
(2) 7 < ap 


for some sufficiently large p. 

To prepare for computation in this and later sections, define, for 
each nonnegative integer a, the ath partial moment m,(z; 0) (or simply 
m,(z)) of any 0 at z in [—1, œ) thus: 


(3) Malz; 0) = faz, w° d0(w). 
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Note that 


(4) m,(sz; [s6]) = Í, w* d[sé](w) 


<sz 


= (sw)? d0(w) = s*m,(z; 0) 


w<z 


for all positive s. 

If y = [0 + f] is a fair or subfair gamble available in a casino at f 
for some f e (0, 1), then, using (1), (3), and (2), yQ can be estimated 
thus: 


(5) YQ =+ = | Qf + 9) delo) 


= | QC +9) d0(g) + md(f) 


g<f 
< MAAR) + mi(f/Q(f) + me(flaB + mP) 


where, in view of (2) and of the nonpositivity of m,(f), 


(6) R(f; 0) = a Mo fIQ(f) + am (AÀ) + mB 
< pio(f)f + mif) + m(f)B 
= S(f; 4), 

say. 


If now y e To(f) and y = (f), then 6 = [fs6o] for some s in (0, 1], 
where 6) = [yo — 1]. Using (4) and abbreviating f/fs by z, 


(T) S(f;Lfs0]) = pio ($: to) T+ fom, ($: s) pm ($ s) 8 
fs fs fs 
= {pmo(z)z? + mi(z)z + Bfme(z)}fe-? < T(z; 0o) fz, 


where 


(8) T(z; 90) = polz; 0o)z? + mi(z; 0o)z + Bme(z; A) min (1, 2). 
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In summary, if @ is such that T(z; 0o) < 0 for all nonnegative z, 
then the U of Tp is majorized by Q. It remains to construct a fair 4 
on [—1, ©) that satisfies this inequality for all z > 0. This will be 
done by choosing a suitable member of the family of probability 
densities, 


D(L + asl +w) for —1 < w < 0, 
(9) p(wls, b) = 4 (1 + 6)w-28 for 1<w, 


0 elsewhere, 


with 0 < b < 1 and ô > 0. As is easily checked, p is aprobability 
density of mean 


ltôg 
(10) TF Pe ea 


Let b henceforth be so chosen that (10) vanishes, which will ensure 
mi(6) = 0. It will be enough to remember that b/b = O(6-?) for 
small ô. If 69 is the distribution corresponding to p(w|6, b), this table 
shows the computation of T(z; 4). 


1<2z 
pino(z)2? bz?p bz1-8p 
—b(1 + 8)z —6(1 + 8)z! 
my(z2)z —___—. 
ò ô 
Bm>(z) min (1, 2) — bæ o DB b(1 + 8) (z1 — 1)B 
' k (1 + 36)(1 +28) | (1 +38) (1 + 28) (2% 7 


bz[pz — 6-1 + BO(1)] bz-[p — 8-1 + BO(1)] 


Clearly, for sufficiently small ô, T(z; 6o) is nonpositive for all 
z > 0. There is great latitude in the choice of a ĝo that makes (8) 
nonpositive; we have made a simple choice showing that yo can have 
a densitv and attach positive probability to all neighborhoods of —1. 
The seemion ıs summarized by a theorem. 
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THEOREM 1. For every positive e and for f in (0, 1), there is a 
rich man’s casino T for which U(f) < e and such that I'(1) contains 
a fair, conventional gamble other than 6(1). 


3. WHEN IS A CASINO FAIR? 


A casino that contains superfair gambles has been shown to be 
superfair. With this case out of the way, the fundamental question 
concerning fair casinos is answered in terms of the set of lotteries 
©(1) = [T(1) — 1] by Theorem 2 and, in a preliminary way, by 
Theorem 1. (As usual, w A z is the minimum of the two numbers 
w and z.) 


THEOREM 1. For a casino T that contains no superfair lotteries, 
these three conditions are equivalent: 

(a) T is fair. 

(b) There is a positive z such that, for every positive e, there is a 0 
in @(1) with 


(1) = J (w A z) d0(w) < e J (w A 2)? d6(w). 


(c) For every positive z and e, (1) has a solution in @(1). 


The content of Theorem 1 would plainly be unchanged by the 
removal of “z2” before the first integral of (1). But this “z’’ serves to 
make e dimensionless. 


Proof that (b) and (c) are equivalent: Clearly, (c) implies (b). 
The reverse implication will develop from the next few paragraphs, 
which are of some interest in themselves. 

If e, z, and 0 satisfy (1), then so do e, sz, and [s0]. Thus, if (1) 
can be solved in @(1) for a specified positive e and z, it can also be 
solved for that «e and all smaller z. 

If e, z, and 0 satisfy (1), and 2’ > z > 0, let € = ez’/z, and note 
that e’, 2’, and 6 also satisfy (1). 

It is now evident that, if some positive z satisfies condition (b) 
of the theorem, all positive z do; so (b) does imply (c). Still more, if 
some positive z fails to satisfy condition (b) for some positive e, then all 
larger values of z fail for that e, and all smaller z, say sz, fail for se. 
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The next two lemmas are used in the proof that (a) implies (b). 


LEMMA 1. Suppose that, for some ein (0, 1), every lottery @ avail- 
able in a house I on the nonnegative reals is permitted by the quadratic 
function Q, Q(x) = ex? + &, that is, f Q(x) d6(z) < 0. Then Q is 
excessive for T. Consequently, for any u, if Q > u, then Q > U. 
If it is supposed only that every 6 available at every f in [0,1] is 
permitted by Q, then Q A 1 is excessive and Q > U for the usual u. 


Proof: For 0 permitted by Q, and y = [f + 6], compute thus: 


(2) YQ = | QF + z) do(a) 
= f (Q) + 2efe + Q(a)} dole) 


= Q) + 2f | z dolz) + f Q(z) dola) 
< Of) +0+0 
= Qf). 


Therefore, if every available 6 is permitted by Q, Q is excessive; 
if every 6 available at every f in [0, 1] is permitted by Q, then Q A 1 
is excessive. In either event, Theorem 2.12.1 applies. ¢ 


(Lemma 1 is weaker, but also considerably simpler, than Theorem 
9.4.1.) 

For each measure 0 and real number z, the curtailment 0 A z of 
6 at z is the measure that agrees with @ on subsets of (— ~, z) and that 
assigns to {z} the value 6[z, ©]. The curtailment T A z of a house 
T based on a set of real numbers is defined by 


(TA 2(f) = {y Az: fory eT (f)}. 
LEMMA 2. If T, is the curtailment at 1 of a house I on a set of 
real numbers and if u is the indicator of [1, ©), then Ui = U. 


Proof that condition (a) of Theorem 1 implies (b): If T is fair, then, 
according to Lemma 2,so is I’ A 1. Lemma 1 then provides for each 
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e > 0 a 0* available in T A 1 at some f in (0, 1], for which 


(3) 0< f Qw) dow) = f Qw) dla A A — Nw) 
< f Qw) ao A w) = f Qw A 1) do(w) 
= f fe(w A 1)? + &w A 1)} delw) 


< ef (w A 1)? d0(w) + f (w A 1) d0(w), 
where 0 is available in T at f and hence at 1. ¢ 


Proof that condition (c) of Theorem 1 implies (a): The program 
is to show that the utility function f A 1 is nearly attained by a 
stationary family of strategies that resembles the proportional family 
studied in Chapter 10. For every lottery 0 carried on [—1, ~) and 
for every z and a, where z > a > 0, the standard stationary family of 
strategies o(f; 0, z, æ) is defined for each f by the gamble 


Lre | fr te <yf<i 
(4) sana = |l z +J Ta. S , 
ò(f) elsewhere. 


The abbreviations o(f) and y(f) will be used for e(f;0,z2,«a) and 
v(f; 6,2, a). The idea behind the definition of standard strategy is 
this: If the gambler moves at all under o(f), he chooses the fraction fs 
of the lottery 6 that will make y(f)[1 + a, ©) = [fs6 + f][1 + a, ©) 
= @[z, ©); he stands pat with 6(f) if the goal of 1 is already attained, 
or if the requisite s, namely, (f + a)/fz, would exceed 1, since, for 
s> 1, [fs6+f] is not generally in [(f). If [6+ 1] eT(1). then 
y(f) € T(f) and o(f) is available in T atf. It is helpful to think of «æ as 
small and z as large. 

Denote the o(f)-probabilities that fa < (1 + a@)/(1 +2) and 
fn > 1 by A, and Bp, respectively. Of course, A, and B, are nonde- 
creasing in n. It will now be shown that, unless 6 is trivial, An + Bn 
approaches 1 for largen. Let 6 = 6[z, ©). Since each essential gam- 
ble used by o(f) has probability 6 of leading to a fortune of at least 
1+ a, An + Bn > 1 — (1 — 8)”. This proves the required point if 
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8>0. Otherwise, for every n,0 < fa < 1 + a almost certainly, and 
o(f; 6, z, œ) is very like a proportional strategy in which (1 + a) plays 
the role of 0, fortunes are measured down from 1 + a, and the goal 
is (1 + a)/(1 +2). The only difference is that y(f) = 6(f) between 
land1-+ a. Formally, consider the proportional strategy p based on 
the lottery [— 6/z], beginning with the fortune f + a. It is easy to see 
that A, + B, is the probability under p that some fortune among 
(f + a), (fi + a), - °° , (fa +) falls outside of (a, (1 + a)z/(1 + 2)]. 
This approaches 1 in n if 6 is nontrivial, as can be seen by applying 
Lemma 10.3.1 modified in the spirit of Section 10.4 so as to apply to 
general lotteries. 

Let Q be any strictly convex, increasing, quadratic function of f 
such that Q(f) < f in [0, 1] and Q(1) > 0. As will be shown in the 
next paragraph, there is a 6 in @(1), and a z and an a such that 


lt+a. 


(5) QG) <0 for f < i 


(6) v(f; 9, 2,@)(Q A 1) 2 (Qf) A1) for all f. 


Consider the implications of this anticipated conclusion. First, 
Lemma 2.12.1 can be applied to 1 - (Q A 1), and to the gambling 
house I's, where To(f) = {y(f)} (or {v(f), 6(f)} if one prefers not to 
depart from the usual assumption that 6(f) is always available). 
Hence, 


(7) o(f; 8, z, a) (QG) A 1) 2 (Q(f) A 1) 


for every stop rulet. Next, if t > n, Q(f:) < 0 with o(f)-probability 
at least A,; so the left side of (7) is at most 1 — A,. But A, + Bn 
approaches 1, so lim B, > Q(f) for f in [0, 1], whence also u(c)(f) = 
Q(f) in (0,1). (This argument is foreshadowed in Theorem 2.12.4.) 
Finally, since Q(f) can be arbitrarily close to f in [0, 1], the promised 
inequalities (5) and (6) will indeed complete the proof. 

Choose a such that Q(1 + a) = 1 and z such that 


as is compatible with the assumptions about Q and the requirement 
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that z > æ > 0. This choice ensures (5). For the interesting range 
of f, namely, [(1 + @)/(1 + 2), 1), and for any 9, 


D RAD = f o(r+ u) aon aw) 


= a + H 


QG) | wale A allw) 


+5 (E42) Ge J ao a a. 


The coefficient of f wd[@ A z](w) is bounded from above, and 
the coefficient of f w? d[@ A z](w) is positive and bounded from below 
for f in the interesting range. In view of hypothesis (c), 0 can there- 
fore be so chosen that { } > 0 forall f of interest. ẹ 


Theorem 1 remains true if the curtailed moments to which it 
refers are replaced by partial moments. 


THEOREM 2. For a casino T that contains no superfair lotteries 
these three conditions are equivalent: 

(a) T is fair. 

(b) There is a positive z such that, for every positive e, there is a 
0 in @(1) with 


(9) —Zz = w dé(w) < e la w? d0(w). 


(c’) For every positive z and e, (9) has a solution in @(1). 


(As in Theorem 1, the “z” before the first integral is to make 
e dimensionless.) 


Proof that (b’) and (c’) are equivalent: The argument that (b) 
and (c) are equivalent applies verbatim. ¢ 


Proof that (b’) implies (b): The left side of (1) is at most the left 
side of (9), and the right side of (9) is at most the right side of (1). ¢ 
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The following lemma, of possible analytical interest, will be used 
to show that (b) implies (b^): 


LEMMA 3. Suppose that «e and 2’ are positive, and @ is any not 
partially remote, probability measure on [—1, œ]. If 


(10) =z fac, w d@(w) > 2e = w? de(w) 


for all z in (z’, ©), then for all z in (z’, ©) 


(11) = f,- w 49(w) > (1 + &z0(z, ©), 
and 
(12) —2 f (w A 2) d0(w) > LSE f (w n 2)? dolu). 


Proof: There is no loss in generality in assuming that 0 is con- 
ventional. To see this, note that the left side of (10) can never 
increase rapidly, and the right side is nondecreasing. If (10) is ever 
violated in (z’, œ), it must then be violated throughout some nontrivial 
subinterval. Therefore, (10) obtains throughout (z’, ©) if and only 
if it obtains at the points of continuity of the functions on the right- 
hand and left-hand sides of (10), which are functions of bounded 
variation. At these points of continuity the values of the two func- 
tions are unchanged if 6’, the conventional companion of 6, is substi- 
tuted for 6; so (10) is satisfied throughout (z’, ©) for 6 if and only if 
it is satisfied for 6’. A similar argument applies to (11) and (12). 
Specialization to.conventional lotteries is now justified. 

The proof involves several integrations by parts, which can be 
justified by, for example, (Widder 1941, Theorem 4b, p. 7), (Saks 1932, 
Theorem 14.1, p. 102), or (Hewitt 1960, Theorem A). Some instances 
of the general formula 


aad fod fi W aru) = [ov aF(O, 


where ¢ and y are bounded and Borel measurable and F is of bounded 
variation and continuous from the right, are also involved. 
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Calculate thus for z > 0, in the notation of Section 2. 


(14) mole) = f° wt dmu) 


—2-'m,(z) + in w-?m,(w) dw. 


(15) m2(2) = f ae w dimy(w) 
= zgm,(z) — ae mlw) dw > 0. 


If (10) obtains in (2’, <), then, according to (15), 

w+0 
(16) —(1 + 2€)mi(w) > — ew! er m,(v) dv 
for w in (z2’, <). Therefore, 


(17) (1 + 26) [ a w-2m,(w) dw 
< 2e [wt [°° mile) do dw 


= ez? AORA mi(w) dw + e ie w-2m,(w) dw 
for z in (2’, ©). Therefore, 
(18) (1 + e) ie w-?m,;(w) dw < ez~? eee m,(w) dw 
for z in (2’, <). Now, using (14), (18), and (15) in that order, 


mlw) dw 


(19) (1+ zmz) < —(1 + e)emi(z) + € ae 


—1-0 
= —zm,(z) — eme(z) < — zm,(2), 
so (11) obtains for z in (z’, ©). 
To see that (10) and (11) imply (12), add «/(1 + 3e) times (10) 
to (1 + 2e)z/(1 + 3c) times (11). + 


Proof that (b) implies (b’): If (9) fails for some e and 7’, it fails 
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for that e and all z > z’, and (12) applies to show that (1) fails for 
e = &?/(2 + 3c) and for all z > z’. ¢ 


The proof of Theorem 2 is now complete. 
Lemma 3 is not true in reverse: 


Example 1. Suppose that 0 is fair and conventional, with den- 
sity Az~“t® for z in (1, ©), where ¢ is an arbitrary number 
larger than 1 and A is some positive number. Then, 


eo Ag ttn 
m = = —(t+2) = i 
(20) Mo(z) = Oz, 9%) = A Í, w dw TT 
(21) —m,(z) = A i w-) dw = Azt zmo(z)(t + 1) 
z f P 


(1 + e)zmo(2), 


where «e = 1/t. Therefore, (11) is satisfied. That (10) is not 
satisfied is easily seen thus: 


(22) —zm,(z) =z f w dé(w) = a zw d0(w) < J w? dé(w), 


which converges to 0 as z approaches infinity; but m:(z) ap- 
proaches a finite positive limit. 


The following sufficient condition for a casino to be at least fair 
is an immediate consequence of Theorem 2 and Lemma 3. 


THEOREM 3. A casino T is at least fair if, for some positive z and 
for every positive e, there is a 0 in @(1) for which 


(23) = foe” do(w) < (1 + €) 26(z, ~). 


If (23) is satisfied by z, e, and 9, it is also satisfied by sz, «e, and 
[s0]; therefore if some z satisfies the condition of Theorem 3, so does 
any smaller z, though some z may be too large to satisfy it. 


Example 2. Let I be generated by a single fair 0 carried on 
[—1,r], with r the least such number. The theorem applies 
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with z any number less than r, but it does not apply with any z 
as large as r, since the right side of (23) vanishes for such z. 


It is easy to prove Theorem 3 directly, along the lines of the proof 
that condition (c) of Theorem 1 implies condition (a), with the simpli- 
fication that linear functions can play the role here that quadratic 
ones do there. This was almost done in Section 4.4. 

We mention Theorem 3 because (23) is simpler than (9). As 
will be apparent later, however, the sufficient condition of Theorem 3 
is vastly more restrictive than conditions (b’) and (c’) of Theorem 2. 


4. FAIR, SIMPLE-LOTTERY CASINOS 


To apply and illustrate the general conclusions of the preceding 
section, specialize @(1) in this section to consist of a set of simple 
lotteries. A simple lottery 0 is characterized by the triple (s, t, w); 
6 loses the stake s with probability w and wins a prize t with probability 
w. The immediate object is to determine which sets of triples cor- 
respond to fair casinos. Denote the first and second moments of 6 
simply by m, and mz, and introduce a subfairness coefficient ¢, ¢ = 
—m:ı/mə. Written out, 


(1) Mı = tw — su, 

(2) M = Uw + s0 = (t + sw + mi, 
sw — tw 

(8) o = a + Pw 


To set aside superfair lotteries as uninteresting here, assume 
throughout this section that m, < 0 for all 6 in @(1). 


THEOREM 1. If ©(1) consists of simple lotteries none of which 
are superfair, these four conditions are equivalent: 

(a) The casino is fair. 

(b) For every positive z and e there is a 6 in @(1) such that t < z 
and ¢z < «e. 

(c) For every positive e there is a 0 e @(1) such that ¢ < «e and 
@< €. 

(d) For every positive e there is a 0 in @(1) such that ¢ < ¢ and 
gt <e. 
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Proof: According to Theorem 3.2, if the casino is fair, there is, 
for every positive z and «e, a 0 in @(1) such that —zm,(z; 0) < em2(z; 8). 
This inequality cannot obtain if e < z < t, for it would mean zsw < 
es’, or z < es. Thus, for e < z there must be a @ with t < z and 
—2zm, <em>. And the inequality t < z can be made strict by con- 
tracting 0 slightly. Since the condition t < z and —zm, < em, can 
be satisfied for all positive z and small positive e, it can be satisfied 
for all positive z and e; so (a) implies (b). 

(b) implies that, for a certain 6, —zm(z; 0) < em2(z; 6). So, 
according to Theorem 3.2, (b) also implies (a). 

If (b) obtains, substitute e for z and e? for e in (b) to conclude (c). 
Conversely, if (c) obtains, choose the e in (c) smaller than both the z 
and ¢/z of (b). Thus (b) and (c) are equivalent. 

It is evident that (c) implies (d). Finally, it will be shown that, 
under (d), there are 6’s with ¢ and ¢ arbitrarily small, as required by 
(c). For if (t, $) corresponds to a 6 in @(1), then so do all points 
(t, ¢’) on the semihyperbola 0 < t < t, t'o = tọ. Specifically, if 
there is a 6 with @ < « and ¢t < e for some «e in (0, 1), there is also a 
6’ with t’ < e? and ¢’ < e/?. First, if t < e!/?, let t = tand ¢’ = ¢. 
Otherwise, 6’ = [e'/?6/t] is in ©(1) along with 0. But t = (e/2/t)t 
= «1/2 and @ = (e!/2/t)—16 = pie“? < 2. @ 


COROLLARY 1. If ¢ is bounded, the casino is fair if and only if 
there are 6’s with ¢ arbitrarily small. 


If, for every bounded lottery 6, ¢ is interpreted as the essential 
upper bound of 6, the four conditions of Theorem 1 are meaningful 
for any casino all of whose lotteries are bounded. The proofs given 
in Theorem 1 that conditions (b), (c), and (d) are equivalent and imply 
condition (a) apply to any casino whose lotteries have bounded carriers, 
with almost no change. However, condition (a) does not imply con- 
dition (b) for all such casinos. 


Example 1. For 0 < ô< 1/3, let 6; attach probability $+ ô 
to —1, § — ô — ô? to 1, and ô? to 6-'._ Let T be the casino for 
which O(f) = {[a#]: 0 <a <f,0 < < 1/3}. As is easily ver- 
ified, T is fair but does not satisfy condition (b) of Theorem 1. 


For some questions it is convenient to introduce the shape param- 
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eters t, 6 of a lottery, where 


(4) i= 5; t= st 
. _  ö—-w _¢ 
(5) O80 = ct Bey? Ox = 


These are ‘shape parameters” in that the and ¢ of a lottery 6 
are equal, respectively, to the ĉ and ¢ of [a6] for any positive number a. 
If © is a set of simple lotteries, all with s < 1, then there is a smallest 
casino for which @(1) D ©. For this casino, 


(6) = U [a0,]. 


<ea<l 


If this smallest casino is at least fair, and only then, every casino for 
which ©@(1) D Ox is at least fair. The following corollaries all refer 
to the smallest casino associated with ©, called the casino of Ox, and 
it is to be understood that ©, includes no superfair gambles. 


COROLLARY 2. The casino of ©, is fair if and only if, for every 
positive e, ¢ < «and $t < e for some 6 in Ox. 


COROLLARY 3. If ¢ is bounded on ©,, the casino of ©, is fair if 
and only if, for every positive e, ọ < e for some 9 in Ox. 


COROLLARY 4. If s is bounded away from 0 on ©,, the casino 
of ©, is fair if and only if, for every positive «e, 6 < «e and ¢i < e for 
some ô in Ox. 


COROLLARY 5. If ¢ is bounded and s is bounded away from 0 
on ®©, the casino of ©, is fair if, and only if, for every positive e, 
$ < e for some 90 in Ox. 


Example 2. Let ©, consist of simple lotteries ðs for which 
s=-1, t=w=6. For 6, $= ¢ = (6 — 68)/(5 + 8) = 
5/(1 + 58); so the casino of ©, is fair according to Corollary 5. 
On the other hand, as is easy to verify, the condition of Theorem 
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3.3 is not satisfied for this uniformly bounded casino. This 
suggests how far the sufficient condition for fairness stated by that 
theorem is from being necessary. 


5. FAIR, ONE-GAME CASINOS 


Recall from Section 4.7 that a casino is a one-game casino gener- 
ated by 6 if 0 e @(1) and every element of ©(1) is of the form [sé] for 
some nonnegative s. The definition was so phrased that the set of s 
for which [s6] e @(1) can be a half-open or a closed interval with 0 as 
its lower endpoint. 


THEOREM 1. If Iisa one-game casino generated by a 6 for which 


6(z, ») approaches 0 as z approaches œ, these three conditions are 
equivalent: 


(a) The casino T is fair. 
(b) 6 is nontrivial, and 


(1) lim inf — 5 = 9 


(c) 0 is nontrivial, satisfies (1), and is a fair lottery; that is, 0 has 
mean 0. 


Proof: Suppose first that T is fair. Then, according to Section 
4.4, 6 is at most fair and is nontrivial. Consequently, m2(z) is uni- 
formly positive for positive z, the limit inferior in (1) is at least 0, 
and the numbers s for which [s0] € (1) are bounded from above. 
According to Theorem 3.2, for every positive z and e there must be an s 
with [s0] in O(1) and —zm,(z; [s6]) < eme(z; [s6]). In view of (2.4), 
—zm,(z/s; 0) < esm2(z/s; 6). Since s is bounded, this shows that (1) 
obtains, and (a) implies (b). 

Calculating in the opposite direction, (b) implies (a). 

Clearly, (c) implies (b). What remains to be shown is only this: 
If (b) obtains, 6 is at least fair. But if 6 were not at least fair, mi(z; 0) 
would be uniformly negative in z and (3.15) would contradict (1). @ 


THEOREM 2. Each of the following conditions ona nontrivial lot- 
tery 6 of mean 0 implies all of its successors and none of its predecessors: 
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(a) 0 has bounded support. 
(b) 0 has finite variance. 
(c) 0 is such that 


(2) lim inf —z f, 


Z> @ 


<,  d6(w) 


is 0. 
(d) 0 is such that (2) is finite. 
(e) The one-game casino generated by 9 is fair. 


Proof: Obviously, (a) implies, but is not implied by, (b). If 
(b) obtains, 


(3) —z f,- w dow) =z J...» dow) < = w? dé(w), 


and the final integral in (3) approaches 0 as z approaches infinity. 
Therefore (b) implies (c). If —m,(z) = A(z log z)—! for z in (2, œ), 
then (c) obtains but (b) does not. 

Obviously, (c) implies (d). If —m,(z) = Az—!, then (d) obtains 
but (c) does not. 

If (d) obtains but (b) does not, then (e) is obvious in view of 
Theorem 1. If (d) and (b) obtain, then so does (c), but (b) with (c) 
implies (e) in view of Theorem 1. So (d) implies (e). 

If —m,(z) = Az log z for z > 1, then (d) fails but, according to 
Theorem 1, (e) obtains. ¢ 


According to condition (b) of Theorem 2, a fair 0 that has a finite 
moment of order 2 generates a fair casino. The order 2 is critical; 
that is, for every r, 1 < r < 2, there is a fair 6 that has a finite moment 
of order r but generates a subfair casino. 


Example 1. If 6 has a density proportional to w`" for w in 
(2, ©), then 6 has moments of all orders up to but not including r 
and, by Theorem 1, is subfair if r is less than 2. Ifr = 2, 0 hasan 
infinite second moment and does not even satisfy (2), but it gener- 
ates a fair casino. If r > 2, the second moment is plainly finite 
and the casino is fair. 
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Theorem 1 is of course a specialization of Theorem 3.2. In the 
same spirit, the next theorem, partially proved in Section 4.4, special- 
izes the rather feeble Theorem 3.3. 


THEOREM 3. IfT is a one-game casino generated by a not super- 
fair 6, then T satisfies the condition of Theorem 3.3 (and is therefore 
fair) if and only if, for every positive «e, there is a positive z for which 
(4) aR TE. do(w) < (1 + €)z0(z, œ). 

Applied to a fair lottery, (4) has a neat interpretation. Namely, 
the expectation of the prize, given that it is more than z, is less than 
(1 + e)z. But the condition (4), like that of Theorem 3.3 from which 
it is derived, is excessively strong. In fact, Example 3.1 shows that 
some very simple distributions having finite variance (or any other 
moment of fixed order) do not satisfy the condition of Theorem 3. 

An example will now be adduced to show that “lim inf”? cannot 
be replaced by “lim” in Theorem 1. The same example will show 
incidentally that the condition of Theorem 3 can apply to a @ for which 
even condition (d) of Theorem 2 fails. 


Example 2. Let 0 attach probability 1 to the set consisting of 
— 1 and the integers n!, n = 1,2, - - -. Further, let —m,(n!) = 
4A27/(n + 2)!, where A is of course determined by normalization. 
According to (3.15), 


(5) m(n!) 


ET wW dm,(w) 


af—1} + Ol} + X kmk) — mk — 19) 
k=2 


é 9k—1 Dk 
BTA de lz FD ŒF zil 


=B+4} 


k=0 


= Dk Dk-1 
=B+A Y |p a ETI] 
2 


2+—1k 
(k + 1)(k + 2) 
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Therefore, —n!m,(n!)/m2(n!) ~ (n + 1)-1; so (1) is satisfied, and 
6 generates a fair casino. But, for n > 1, 
—nlmi(n! — 0) _ —n(n — 1)!mi((n — 1)!) ae 
m(n! — 0) m((n — 1)!) 
so (1) would not be true with “lim” in place of “lim inf”. 
According to (3.14), 


(6) Ton) = [wnt dma(w) 
ee ee 
p 2n j lana +1)! (k+ zl 
_ m(n) 
| (n m+)! 
Therefore, 


mi(n! — 0) = mi((n — 1)!) ~ nliio((n — 1)!) = n!'ño(n! — 0), 


and condition (4) of Theorem 3 is satisfied, though condition (2) 
of Theorem 2 is not, and 6 has infinite variance. 


As Example 2 shows, “lim inf” in (1) cannot be replaced by 
“lim.” It cannot be replaced by ‘‘inf’’ either, though in a sense it 
nearly can. If the denominator in (1) is bounded away from 0 for 
all positive z, that is, if 6[—1, —e) > 0 for some e > 0, then the 
fraction in (1) approaches 0 for small z. But if the infimum of the 
fraction outside of some neighborhood of 0 is 0, then its lower limit 
as z approaches œ is also 0. More fully, if 6 is fair and nontrivial, 
either —2m,(z)/m2(z) is bounded away from 0 on every interval 
bounded away from both 0 and œ, or it is identically 0 for sufficiently 
large z. This follows from calculation, for z > 0 and ¢ > 1, thus: 


— tzm,(tz) e —tzm,(z) z =] 


mo(tz) T mz) ma(2z) 


(7) 


For fair 0, (1) can be rewritten 
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The numerator in (8) is equal to that in (1), and the denominator of (8) 
differs from that of (1) only at points of discontinuity of 6. Thus, 


in view of (7), (1) and (8) really are equivalent. Obviously, (8) 
implies that 


2 f, do(w) 
(9) liminf ——~———— = 0 
oe we, W? 26(w) 
and this is known to be a necessary and sufficient condition for the 
distribution 6, which is bounded from below, to belong to the domain 
of partial attraction of the normal law; see, for example, (Gnedenko 
and Kolmogorov 1954, p. 190). 


Equation (8) is definitely stronger than (9), even for fair 6, 
according to this example. 


Example 3. Let 6 be a fair lottery confined to —1 and numbers 
of the form zn = 27°/n?, n = 1, 2, °-- , with 6{z,} = A2-*’, as 
is possible. The fraction in (9) is, at z, + 0, asymptotic to 2-2-1; 
so ð is in the domain of partial attraction of the normal law. 
But the fractions in (1) and (8) approach ©; so 6 does not gen- 
erate fair casinos. 


If 0 is fair and 6(z, ©) = Mmo(z; 0) is sufficiently small for large z, 
then 0 will generate a fair casino. For in this case, 6 will have finite 
variance. One might conjecture that, conversely, if 6(z, ©), for a 
fair 6, is sufficiently large, then 6 cannot generate a fair casino. Sur- 
prisingly, this conjecture is far from true. In fact, for any lottery 6 
of finite mean carried on [—1, œ), there is a conventional lottery ¢ of 
mean 0 carried on [—1, œ) that generates a fair casino and is such 
that ¢(z, ©) > (z, ©) for all z in some interval [zo ©). Still more, 
o can be made to satisfy the relatively severe condition of Theorem 3, 
as the next theorem states. 


LEMMA 1. If 6 has a finite mean, there is a conventional ¢ with 
finite mean such that ¢(z, ©) > ofz, æ) for all z. 
Proof: For some positive y, let F(x) = lim 0(— %, xz — y + 6). 
e—0 


F is the distribution function of a conventional ¢, and F(z) = ¢(z, ©) 
= lim lz — y +e œ) > blz, %). + 
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LEMMA 2. If 0 is conventional and has finite mean m, there is, 
for each positive e, a conventional ¢ such that the mean of ¢ is at most 
m + e, o(z, ©) > 6(x, ©) for all z, and for each positive ô there is a 
positive z for which 


(10) fas. 280) < (1 + d)26(, »). 


Proof: If 6(z, ©) = 0 for some finite xv, then 90 itself can serve 
for ¢, as is easy to see. Assume, therefore, that 6(x, ©) is positive 


for all finite z. Let «, e2, © © © be a sequence of numbers in (0, 1) 
such that 
(11) e < é 

j=i+1 


for all 7. For instance, let « = 27%. Choose a; > 0 so that 
(12) Jose.” d0(w) < eè. 


There is a unique b; for which b:0(aı, ©) = e1, and bı > aı. Choose 
Qi+1 > b; such that 


(13) fasat d6(w) < é, 
and let b; be the number for which 

(14) b:0 (ai, ©) = éi. 
Since the a; approach œ, and 

(15) ai < bi < diya, 


the b; approach œ. 
For each z, let i(x) be the least ï for which x < b;. Let T(z) = 
6(— œ, x] and G(x) = T(aizy). Clearly, G(x) is nondecreasing and 
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continuous on the right, and satisfies 


(16) ff) wdG@w) = Y OTa) — T(a)) 


j>u(z) 
= b;(A(— ©, aj41] — 0(— œ, a;l) 
j2i(z) 
< b;0(a;, ©) = €j 
jDilz) j>i(z) 
= €i(z) aa €j < €iça) T Eia. 
j>ilx) 


Let F(x) = min (T(x), G(z)). Clearly, F is a distribution func- 
tion, and, for some conventional ¢, ¢(z, ©) = F(x) > T(x) = (x, œ) 
for all x, as required. 


(17) fin. 2 dow) < f,» aT) + dG(w)) 
= fote + [a6 


< = w d0(w) + eig) + Exa 

< e&t (ati)  ife=b—0 

= e(1 + 2e:) = b:0(a;, ©)(1 + 2e;) 

= biola, ©)(1 + 2€:) = bip(z, ©) (1 + 2e:) 

= ro(z, ~)(1+2e4+0). + 
LEMMA 3. If 6 is conventional and has a finite mean, there is a 
conventional @ with 0 mean such that ¢(z, ©), = 6(z, ©) for all 


sufficiently large z. If 6[—1, ©) = 1, ọ can be so chosen that 
g[—1, ©) = 1. 


THEOREM 4. If @ has a finite mean, there is a conventional ¢ 
with mean 0 such that ¢(z, œ) > @[z, ©) for all sufficiently large zx, 
and such that (10) has a solution in z for each positive ô. If @[—1, œ) 
= 1, ¢ can be chosen so that ¢[—1, œ) = 1. 
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6. OPTIMAL STRATEGIES FOR FAIR CASINOS 


Suppose that every y €I(1) is countably additive on the Borel 
subsets of [0, ©). It is then natural to inquire about the existence of 


optimal Borel-measurable strategies, where e = oo, © +: , on, °° + is, 
as usual, Borel measurable if each oc, is countably additive on the 
Borel sets A, ando,(fi, © © © , fa) A is Borel measurable in fi, © © © , fn 
for each A. 


As is not difficult to see, unless there is some y e€ T(1) other than 
6(1) that is fair, has bounded support, and attains its upper bound 
with positive probability, there is no optimal Borel-measurable vø. 
On the other hand, the presence of such a gamble in a fair casino 
ensures the existence of an optimal Borel-measurable strategy. The 
simplest one is the bold strategy based on that y. As usual, to play 
boldly means to stake just enough to reach the goal when rich enough 
to do so and otherwise to stake all. ; 

If a conventional fair gamble y attains its essential upper bound 
with positive probability but does not attain its essential lower bound 
with positive probability, then a gambler who uses the bold strategy 
based on y, or indeed any optimal strategy based on y, is in the 
uncomfortable position of having positive probability of gambling 
forever. Equivalently, there is no optimal Borel-measurable wide- 
sense policy based on such a y, where (øs, t) is a wide-sense policy if t 
stops with inner o-probability 1. A necessary and sufficient condi- 
tion for the existence of a Borel-measurable, optimal wide-sense 
policy based on a given fair, conventional y is that both the essen- 
tial least upper bound and the essential greatest lower bound of y be 
attained with positive probability and that they differ from each other. 
Clearly, the bold strategy o, with the associated natural incomplete 
stop rule t—stop when the fortune is 0 or 1—is such an optimal wide- 
sense policy. Thus, if a fair T has available such a fair y, then meas- 
urable, optimal wide-sense policies do exist. The existence of such a 
fair y is, however, not necessary for the existence of measurable, 
optimal wide-sense policies. It suffices that there be in I'(1) a fair, 
conventional gamble y, other than 6(1), that attains its least upper 
bound with positive probability, and a fair, conventional gamble y’, 
other than 6(1), with bounded support, that attains its lower bound 
with positive probability. Indeed, this condition is both necessary 
and sufficient. 
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Return now to the question of the existence of optimal strategies 
when no gamble attains its least upper bound with positive probability. 
As was observed above, under these conditions no Borel-measurable, 
optimal strategies exist. Yet there are optimal strategies for at least 
some such fair casinos. 


Example 1. Let r(f) = [f0(1) + f] for all f in [0, œ), where 
©(1) contains all lotteries that are fair and countably additive 
on the Borel sets of [—1, ©) except those that attain their upper 
bounds with positive probability. An optimal family of strategies, 
and of policies with two moves, can be constructed for this casino. 
Let (0, 1) be partitioned into a denumerable number of sets B,, 
each of inner Lebesgue measure 0. Let oo = oo(f), for f in 
(0, 1), be any element of T(f) that is carried by (0, 1) and that 
attaches probability 0 to each of the B,; let oo(f) = 6(f) else- 
where. (Though completely additive on Borel sets, oo is not, 
and is not here expected to be, completely additive on all the sets 
for which it is defined.) Let oi(f), for f in Bn, be any element of 
I'(f) that is carried by {0} U (1 + (2n)-!, 1 + n-4]; let oi(f) = 
6(f) elsewhere. Let on(f) = 6(f) for all n > 2 and all f. The 
strategy just defined stagnates with probability 1 but almost never 
at f = 1. With evident notation, 


(1) u(o(f) 2 doo(filf) 


Fern I+ Gi 


>J 
— Jn(fiyam 


m 
© m + 1Jrm 


fi doo(filf) 


m 
= eet 


So the strategy o is worth f and is therefore optimal. 


12 
THE SCOPE OF 


GAMBLER’S PROBLEMS 


1. INTRODUCTION. Our general notion of a gambler’s prob- 
lem grew gradually out of our study of specific problems. In 
arriving at the notion, we sought a mathematically natural and 
convenient setting for these problems, without aiming at great 
generality. However, various other problems that at first 
seemed not to fall within the theory of gambler’s problems actu- 
ally do so; and this theory is closely akin to other general theories 
already current in mathematics. The object of this final chapter 
is to bring out this flexibility, generality, and kinship, by means 
of suggestive examples. 

One respect in which the theory developed in this book is 
not as flexible as might be desired is that it is restricted to 
bounded utilities. A suggestion toward the relaxation of the 
restriction was made in Section 2.8. Some examples in this 
chapter presume utilities unbounded from one side, which is a 
relatively simple extension of Chapter 2. 


2. FORTUNES 


Much of the flexibility of the general gambler’s problem 
derives from the diversity of the objects that can play the role 
of fortunes. 

For the first illustration of this principle, consider so gen- 
eralizing the definition of a gambling house that the set of 
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gambles available to the gambler depends not only on his current 
fortune but also on his previous fortunes. (For example, there could 
be rules requiring the gambler to desist from certain gambles unless 
he has won, or lost, a specified sum of money sometime since beginning 
to play.) The apparent generalization can easily be made, but it is 
apparent only; for the general situations are seen as instances of the 
special ones on suitably reinterpreting “fortune’’. 

Imagine, in fact, rules which, interpreted with respect to a set F 
of fortunes f, allow the gambler who has experienced the partial 
history (fo, fi, © © © ,fxz)—in this context, fo is reckoned as part of the 
partial history—to choose a gamble yon F fromaset I'n(fo, fi, © © © , fa). 
Only if Tn(fo, fi, © © © , fn) = Polfa) for all partial histories is the 
situation a gambling house (in the technical sense of Section 2.4). 
Yet, if the partial histories f’ = (fo, fı, © © © , fa), rather than the 
elements f of F, are regarded as fortunes, the rules evidently do define 
a gambling house on the set F’ of these fortunes. More formally, 
let T’(f’) consist of those gambles y’ on F’ constructed from elements 


y of Ta(fo, f1, © © * , fn), thus: The probability under y’ of the set of all 
immediate continuations (fo, fı, © © © fa, fn+1) Of the fortune f’ = 
(fo, f1, © © © , fa) is 1, and the probability under y’ of a subset of these 


continuations is the probability under y of the corresponding set of 
values of fn+ı. 

With this reinterpretation, strategies with initial fortune f in 
the generalized gambling house are easily seen to be isomorphic to 
strategies in F’ with the initial fortune f’ = (f). Toa utility u on F 
corresponds a utility u’ on F’ defined by u’(fo, fi, © > © y fn) = Ulfa). 

Problems can arise, in which the gambler’s utility depends not 
only on his terminal fortune but on his initial fortune and the history 
of his fortunes up to termination, as when the pleasures and pains 
of the gambler are affected by the course of play. The artifice of 
regarding partial histories of fortunes in F as fortunes in F” is again 
applicable to reduce this extension of gambler’s problems to the 
original form. Some problems whose solution was thus facilitated 
are treated in (Dubins 1962). 

Suppose that the gambles available to a gambler depend not 
only on his present and past fortunes but also on decisions he has 
made in the past. For example, there might be some gamble that 
can be made only once or that can be made only if a deposit has been 
paid several moves in advance. Here again, the situation can be met 
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either by modifying the original theory or by so reinterpreting fortune 
and gamble as to fit the superficially new situation into the original 
theory. 

When T,(fo, fi, © © © , Ja) depends on its arguments in certain 
special ways, a fortune f’ in the new interpretation need not be taken 
to be the whole past history. Two suggestive possibilities are f’ = 
(f, n) and f = max (fo, fi, © © + , fr). 

In general, the space of fortunes F of a gambler’s problem can be 
enlarged arbitrarily without material effect on the problem. In 
order to take advantage of the general theory of this book, F must be 
chosen large enough for the gambler’s opportunities T and his aspira- 
tions u to be functions of f alone; simplicity often dictates an F about 
as small as is compatible with this condition. 


3. OPINION AS A COMPONENT OF FORTUNE 


The following example about a blindfolded roulette player, which 
at first seems outside of the original theory, introduces still other 
interpretations of fortune. The player deposits d dollars with a 
banker who, according to the player’s instructions, bets sı dollars 
(where sı < d) on red at a roulette table. As a result, the banker 
will then hold for the player either d + sı or d — sı, say dı, dollars 
according to the probabilities w and #. The player, from whom 
knowledge of dı is withheld, may now terminate play, in which case 
he goes home with d, dollars, or he may offer to bet sz dollars on red. 
If s2 > di, he is declared bankrupt and goes home empty-handed; 
otherwise the bet is made for him, and the banker then holds dz = 
dı + sı dollars, and so on. The gambler’s cash holdings (or their 
history) cannot be regarded as his fortune if his range of choice at the 
nth move is to be a function of his fortune; for he does not necessarily 
know these quantities. What he does know at time n (that is, after 
his nth gamble, but before his (n + 1)st) is d, si, © * , Sn, and 
whether he has been declared bankrupt. One might therefore let fn 
be this sequence, together with the gambler’s status with respect to 
bankruptcy. The gambler with fortune f, can choose to terminate 
or to stake s,,:. What utility is to be associated with the former 
and what gamble with the latter? 

From the gambler’s point of view at fa, dn is a random variable 
whose distribution he calculates from f, (that is, from what he knows). 
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If he is interested in maximizing the expected value of some func- 
tion u of cash, then he views termination at f, as having the utility 
E(u(d,)|fn), and this can appropriately be regarded as u(f,). Sim- 
larly, if he stakes an amount s,,:, the gambler can calculate the 
probability that this will bankrupt him, and the gamble y associ- 
ated with the choice of s,4; at fa is confined to the two new fortunes 
(d, Sı, © © * , Sn41, Solvency) and (d, Sı, °° © , S241, Bankruptcy) with 
probabilities that depend in a calculable way on s,4; and fn. 

In this problem, the details about f, are important to the gambler 
only insofar as they enable him to calculate his current distribution 
for d,. Instead of taking the patterns of information as fortunes, we 
might also have formulated the problem in terms of distributions ¢ 
of cash on hand. This is an idea of widespread applicability. In the 
present instance: the initial distribution ¢ is 6(d); the utility of ¢ 
regarded as a fortune is u(¢) = f u(d) d¢(d); and a stake s converts ¢ 
into 6(0) with probability ¢(—©,s) and with the complementary 
probability ¢[s, ©) into a mixture of two distributions, weighted 
according to the fixed probabilities w and w% of winning the next bet, 
where the two components of the mixture consist of the distribution ¢ 
truncated to [s, ©) and then shifted forward or backward by s. 

With fortunes regarded as distributions of cash, it is easy to 
contemplate variations in the problem of the blindfolded roulette 
player. For example, any gambling house T defined on cash can 
be substituted for the game red-and-black, and various rules per- 
mitting the gambler to purchase information about cash on hand 
can be introduced. Some such rules (for instance, a rule that allows 
him once or twice to attempt a bet that he cannot afford with a mere 
warning or upon payment of a fine) would require the gambler to 
reckon something in addition to ¢ as part of his fortune. 


4. NONLEAVABLE HOUSES 


Almost all the specific gambling houses studied in this book have 
been leavable, that is, such that 6(f) e T(f) for each f. But finding 
slight advantage, and some disadvantage, in introducing leavability 
as part of the definition of gambling house, we did not do so. Our 
definition of nonleavable gambling houses and their utilities, being 
little motivated by actual situations, might have been expected to have 
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few appealing applications. It is therefore a welcome surprise that 
certain problems which have been studied by others, and which could 
be viewed as leavable problems only artificially at best, have natural 
interpretations as nonleavable problems. A “search problem” is 
described here as one illustration, and another illustration is given in 
Section 6. 

A button is lost in one of, say, three sewing baskets, A, B, and C. 
A quick look into A will reveal the button with positive probability a 
should it be there; the corresponding probabilities for B and C are 
Band y. The problem is to minimize the expected number of searches 
made by one who initially associates the probabilities po, qo, and ro 
with the presence of the button in A, B, and C. It is known to be 
optimal to look into A, for instance, at a given moment if and only 
if the present probability ap, of finding the button in A immediately 
is at least as large as the corresponding probabilities Bg, and yr, for 
the other baskets. (Closely related conclusions are announced in 
(Bellman 1952).) 

How can this problem be viewed as a gambler’s problem? By 
now, it will seem natural to take for a generic fortune an opinion 
(p, q, r) and a number of past searches ¿. The button may be regarded 
as found if p, q, or r is 1, in which case the gambler is free to stagnate— 
and will prefer to. Otherwise, the gambler is obliged to increase z by 1 
and to look into one of the baskets. Looking into A, for instance, will 
change (p,q,7) to (1,0,0) if he finds the button there, which has 
probability ap, and to (ap, q, r)/(ap + q + r) if he does not. 

If the utility of the fortune (p, q, r; ù) is reckoned as —2, then 
—u(c,t) is nondecreasing in t; so —u(c) = lim: — u(o, t), which is 
just what is meant by ‘“‘the expected number of searches” in the original 
formulation of the problem. Incidentally, in this problem ¢ is almost 
certainly bounded, as is suggested by Theorem 2.7.2, since each gamble 
assigns probability 1 to a finite set of fortunes. Therefore, lim, u(c, n) 
= lim; u(o, t). 


5. DISCOUNTING THE FUTURE 


A group of problems known as two-armed bandit problems are 
currently attracting theoretical interest. (See, for example, (Robbins 
1952), (Bellman 1956), and (Feldman 1962).) The name ‘‘two-armed 
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bandit? was introduced by Frederick Mosteller in connection with 
experiments in the psychology of learning. For an illustration of the 
idea, consider the following situation. 

A gambler is allowed without charge to play two slot machines 
of unknown characteristics for a total of, say, 100 plays. According 
to what strategy should he decide to allocate his nth play to the first 
or to the second machine? Assume for definiteness that the first 
machine when played pays a dollar with frequency pı and the second 
a dollar with frequency pe. The gambler’s opinion at the nth stage 
of play is given by a probability distribution ¢, on the (pı, p2)-square 
(beginning with an initial opinion ¢), and ¢, changes from play to 
play according to Bayes’s theorem. The problem can be formulated 
as a gambler’s problem thus. A fortune consists of: a distribution 4, 
the number a of plays as yet available, and the amount of cash c thus 
far won. The utility of the fortune is simply c. For each fortune f 
with a > 0, two gambles are available. Both diminish a by 1. The 
first either augments c by 1 and, according to Bayes’s theorem, replaces 
dd(p1, p2) by pı delpı, p2)/f pidd(pi, p2) or else leaves c unaltered 
and replaces d¢(p1, pz) by (1 — pı) do(pı, p2)/f (1 — pı) de(pı, De) 
with probabilities f p:d¢(pi, p2) and f (1 — pı) dd(pi, pe), respec- 
tively. The second gamble is of course analogous. When a = 0, play 
is in effect over; only 6(f) is then available. 

In one variant of the two-armed bandit problem (Bellman 1956), 
the gambler is allowed to play indefinitely, but he discounts the 
future at 100e per cent per play; that is, the current value to him of 
future payments dnii, dn42, © © © is E, (1 — €)"dn4,. 

Insofar as a two-armed-bandit problem is meant to suggest some 
aspects of a going concern such as a business or a medical research 
program, this formulation may represent a certain gain in realism. 
For a going concern does not ordinarily look forward to a predeter- 
mined last day of business, nor does it see distant gains and losses as 
equal in importance to immediate ones. A similar viewpoint might 
be appropriate to a clinic in which closely competing treatments are 
being tried side by side. 

If, for example, the gambler is interested in expected cash and 
has no other reason to discount the future than the possibility that the 
two slot machines will simultaneously go out of order (or be turned off) 
with a probability of «e at each play, then clearly he will evaluate the 
future as postulated. 
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The problem is not now expressed in terms of the value to the 
gambler of his present fortune, that is, in terms of past payments to 
him and his present opinions about the parameters of the machines; 
so it is not yet a gambler’s problem in the technical sense of the term. 
However, since the initial value to the gambler of a future sequence 
of payments dı, dz, © > © is E (1 — e)"d,, his strategic position is the 
same as that of a gambler who does not discount future payments 
but who is actually paid after the (n — 1)st gamble only (1 — e)” 
times what the slot machine emits, that is, d, = (1 — «6)"d,. Thus 
the problem is to all intents and purposes a gambler’s problem in 
which the nth fortune consists of the nth opinion about (that is, the 
probability distribution of) the parameters of the slot machines, 
together with the sum of the payments d, accumulated by the end 
of the nth play. The utility of this fortune is the accumulated 
payments. 


6. A DIFFERENT APPROACH TO THE 
INDEFINITE FUTURE 


A gambler knows that one of the arms of a certain two-armed 
bandit, the “correct” arm, returns a dollar with probability 3/4 and 
that the other, the “wrong” one, does so with probability 2/3. Sup- 
pose his problem is to play forever but with a strategy that minimizes 
the expected number of pulls on the wrong arm. 

As David Blackwell pointed out to us, if the problem is taken 
literally, the utility depends on the entire infinite history even more 
conspicuously than it did in the search problem of Section 4. This 
problem was solved by Feldman (1962). Especially since many 
similar problems remain unsolved, there may be some interest in 
pointing out how they can be viewed as ordinary nonleavable gambler’s 
problems. 

At any given state of play, it is plainly compatible with the 
original formulation of the problem to reckon the gambler’s fortune 
as consisting of what he then knows: his initial probability that the 
first arm was the correct one, and what arm he pulled and what hap- 
pened in each trial to date. The probability p(f) for the gambler 
with the fortune f that the first arm is the correct one and e(f), the 
expectation for him of the number of errors to date, are calculable 
by the familiar rules for conditional probabilities and conditional 
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expectations. (The gambler would seem to have no real interest in f 
beyond the quantities p and e, and he could actually regard them as 
constituting his whole fortune without any loss to himself.) 

Pulling the right arm or the left one results in a random change 
ve(f) or yx(f) in the gambler’s fortune, and this pair of gambles 
constitutes ['(f). 

Perhaps it is obvious that letting u(f) = —e(f) leads to the 
objective prescribed by the problem as originally formulated, but the 
point should be checked, thus. The total expected number of errors 
under o would not be well defined except for the countably addi- 
tive convention according to which it is taken to be the limit as n 
approaches œ of the expected number of errors up to time n. But the 
expectation under o of the number of errors up to time n is the same 
as a(e(f,)), the expectation under ø of the expected number of errors at 
time n given f at time n, or e(c, n). So the original objective of the 
problem is, in effect, to maximize — lim, e(c, n); the limit exists because 
the expected number of errors up to time n is nondecreasing. The 
limit with respect to n is the same as it would be with respect to general 
stop rules ¢, because in this problem, as in the search problem of 
Section 4, every stop rule is bounded almost surely. Thus the original 
objective is indeed to maximize —e(c) over strategies available at the 
initial fortune. 


7. DYNAMIC PROGRAMMING 


The examples in this chapter, and many others, suggest that 
gambler’s problems are more or less the same as problems of dynamic 
programming, a concept introduced by Bellman and exemplified in 
(Bellman 1952, 1957), (Karlin 1955), and (Howard 1961). We say 
“more or less” because, in our opinion, a unique definition of such 
general concepts as those of dynamic programming and gambler’s 
problem cannot fruitfully be attempted. Thus, while the term “‘gam- 
bler’s problem” is ordinarily used in this book for a definite formal 
concept, the term has also a looser, informal connotation. For exam- 
ple, there are natural problems of gambling that require continuous, as 
opposed to discrete, time for their formulation, and so fall outside 
the structure of this book. The problems of Section 9.4, for instance, 
invite reformulation in continuous time; for they would then have 
natural optimal strategies. 
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Dynamic-programming problems are by no means always sto- 
chastic. Nonstochastic problems of course correspond to gambling 
houses in which every element of each ['(f) is some 6(g). 


8. BAYESIAN STATISTICS 


Gambling problems in which the distributions of various quan- 
tities are prominent in the description of the gambler’s fortune seem 
to embrace the whole of theoretical statistics according to one view 
(which might be called the decision-theoretic, Bayesian view) of the 
subject. Before attempting any general definition of statistical prob- 
lems in this sense, we illustrate the concept by a famous and important 
example due mainly to Abraham Wald (whose point of view was not 
Bayesian). 

There is a two-valued random variable H that is 1 with probabil- 
ity po and 2 with probability o. Conditionally on H, a sequence of 
random variables z, is independently and identically distributed 
according to one of two distributions 7x. The gambler’s object is 
to guess H; he receives an award A, say $1,000, if his guess is correct. 
If he guesses immediately, his expected income for a reasonable guess 
is max (poA, poA); call it A(po). Before making his guess, however, 
he is permitted to see the data 21, x2, © - - until he is satisfied, paying 
an observation cost c for each z, that he chooses to see. After each 
such observation, the gambler will associate a new probability p, with 
H = 1 in accordance with Bayes’s theorem. In particular, if the 
na are discrete and countably additive, as will here be assumed for 
definiteness and clarity, then 


(1) Dn t Pam (tn+1) i 
= Dani(Tn41) + Pane(Tn+1) 


The situation can be formulated as a gambler’s problem in which 
a fortune consists of a probability p and an amount C already paid 
for observations. The gambler’s utility for such a fortune is A (p) — C. 
The gambles available to him are either to remain at the fortune (p, C) 
or to increase C by c and to exchange p for pai(x)/[pmi(x) + fn2(x)] 
with probability [pni(x) + pno(zx)]. 

In accordance with Theorem 3.9.5, a natural stationary family 
of optimal strategies in this problem is to stagnate when and only 
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when (p, C) is adequate, that is, when U(p, C) = A(p) — C. In this 
problem, it is almost obvious that U(p, C) = U(p,0) — C. Conse- 
quently, the heart of the problem of finding an optimal strategy is, 
then, to find the set S of values of p where U(p,0) = A(p). Readers 
interested in the solution of this problem of testing a simple dichotomy 
are referred to (Wald and Wolfowitz 1948), (Arrow, Blackwell, and 
Girshick 1949), and (Wald 1950). Here we want only to indicate 
that this problem can be viewed as a gambler’s problem. 

From the point of view of decision-theoretic statistics, the gam- 
bler in this problem is a person who must ultimately act in one of two 
ways (the two guesses), one of which would be appropriate under one 
hypothesis (H = 1) and the other under its negation (H = 2). First, 
however, he may repeat a pertinent experiment (observation of the z,,) 
at a cost c per experiment. His behavior, if he is prudent, will be 
guided by his successive opinions p,, the cost c per observation, and 
the award A. 

Many problems, of which this one is an instance, are roughly 
of the following type. A person’s opinion about unknown parameters 
is described by a probability distribution; he is allowed successively 
to purchase bits of information about the parameters, at prices that 
may depend (perhaps randomly) upon the unknown parameters them- 
selves, until he finally chooses a terminal action for which he receives 
an award that depends upon the action and the parameters. (The 
purchases and the terminal action are, in effect, gambles.) Some 
of the ideas of this branch of statistics are explained in (Savage 1954, 
Chapter 7). Other references to Bayesian statistics are (Raiffa and 
Schlaifer 1961) and (Savage 1962), which has a large bibliography. 


9. STOCHASTIC PROCESSES 


What is the relationship of gambler’s problems (in the technical 
sense of this book) to probability theory in general? ‘‘Strategy’’ is 
a finitely additive reinterpretation of the concept of ‘‘stochastic 
process in discrete time”, the countably additive interpretation of 
which is widely adopted in probabilistic literature, as in (Doob 1950), 
(Loéve 1960), and (Rosenblatt 1962). The analogy between the two 
interpretations is close and systematic. In particular, solutions to 
gambler’s problems typically imply (and, in a sense, strengthen) 
solutions of corresponding problems in a countably additive frame- 


Sec. 9] Stochastic processes 231 


work, as is frequently illustrated in this book and in (Dubins 1962). 
Finitely additive, continuous-time stochastic processes and gambling 
remain to be explored. 

Regarding strategies and discrete-time stochastic processes as 
different technical implementations of the same idea, a gambling 
house is a class of stochastic processes, and the U and V of a gambling 
house define sharp inequalities on such a class of stochastic processes. 
Thus, for example, the class of nonnegative, lower semimartingales 
is the universal fair casino, that is, the gambling house on the non- 
negative real numbers for which T(f) consists of all gambles y with 
ff’ dy(f’) <f. The fact that a gambler in this casino can increase 
his fortune k-fold with probability k-! but no more (for k > 1) is a 
familiar fact about nonnegative semimartingales. A solution of 
gambler’s problems implies an inequality for stochastic processes; 
for the problem of Section 9.4, this implication was mentioned at 
the end of Section 1.2. The search for a bound on some probability 
associated with a stochastic process or class of processes can sometimes 
usefully be reformulated as a gambler’s problem, as is illustrated in 
(Dubins 1962) and (Blackwell 1964). In short, much of the mathe- 
matical essence of a theory of gambling resides in the discovery and 
demonstration of sharp inequalities that pertain to interesting classes 
of stochastic processes. 
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PIANO MUSIC 1888-1905, Claude Debussy. Deux Arabesques, Suite Bergamesque, 
Masques, Ist series of Images, etc. 9 others, in corrected editions. 175pp. 9% x 12%. 
(ECE) 22771-5 Pa. $5.95 


TEDDY BEAR IRON-ON TRANSFER PATTERNS, Ted Menten. 80 iron-on 
transfer patterns of male and female Teddys in a wide variety of activities, poses, 
sizes. 48pp. 8% x 11. 24596-9 Pa. $2.25 


A PICTURE HISTORY OF THE BROOKLYN BRIDGE, M.J. Shapiro. Pro- 
fusely illustrated account of greatest engineering achievement of 19th century. 167 
rare photos & engravings recall construction, human drama. Extensive, detailed 
text. 122pp. 8% x 11. 24403-2 Pa. $7.95 


NEW YORK IN THE THIRTIES, Berenice Abbott. Noted photographer’s 
fascinating study shows new buildings that have become famous and old sights that 
have disappeared forever. 97 photographs. 97pp. 11% x 10. 22967-X Pa. $7.50 


MATHEMATICAL TABLES AND FORMULAS, Robert D. Carmichael and 
Edwin R. Smith. Logarithms, sines, tangents, trig functions, powers, roots, 
reciprocals, exponential and hyperbolic functions, formulas and theorems. 269pp. 
5% x 8%. 60111-0 Pa. $4.95 


HANDBOOK OF MATHEMATICAL FUNCTIONS WITH FORMULAS, 
GRAPHS, AND MATHEMATICAL TABLES, edited by Milton Abramowitz and 
Irene A. Stegun. Vast compendium: 29 sets of tables, some to as high as 20 places. 
1,046pp. 8 x 10%. 61272-4 Pa. $19.95 
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HOW THE OTHER HALF LIVES, Jacob A. Riis. Journalistic record of filth, 
degradation, upward drive in New York immigrant slums, shops, around 1900. 
New edition includes 100 original Riis photos, monuments of early photography. 
233pp. 10 x 7h. 22012-5 Pa. $7.95 


CHINA AND ITS PEOPLE IN EARLY PHOTOGRAPHS, John Thomson. In 
200 black-and-white photographs of exceptional quality photographic pioneer 
Thomson captures the mountains, dwellings, monuments and people of 19th- 
century China. 272pp. 9% x 12%. 24393-1 Pa. $12.95 


GODEY COSTUME PLATES IN COLOR FOR DECOUPAGE AND FRAM- 

ING, edited by Eleanor Hasbrouk Rawlings. 24 full-color engravings depicting 

19th-century Parisian haute couture. Printed on one side only. 56pp. 8% x 11. 
23879-2 Pa. $3.95 


ART NOUVEAU STAINED GLASS PATTERN BOOK, Ed’ Sibbett, Jr. 104 
projects using well-known themes of Art Nouveau: swirling forms, florals, 
peacocks, and sensuous women. 60pp. 8% x 11. 23577-7 Pa. $3.50 


QUICK AND EASY PATCHWORK ON THE SEWING MACHINE: Susan 
Aylsworth Murwin and Suzzy Payne. Instructions, diagrams show exactly how to 
machine sew 12 quilts. 48pp. of templates. 50 figures. 80pp. 8% x 11. 


23770-2 Pa. $3.50 


THE STANDARD BOOK OF QUILT MAKING AND COLLECTING, 
Marguerite Ickis. Full information, full-sized patterns for making 46 traditional 
quilts, also 150 other patterns. 483 illustrations. 273pp. 6% x 9%. 20582-7 Pa. $5.95 


LETTERING AND ALPHABETS, J. Albert Cavanagh. 85 complete alphabets 
lettered in various styles; instructions for spacing, roughs, brushwork. 121pp. 8% x 
8. 20053-1 Pa. $3.95 


LETTER FORMS: 110 COMPLETE ALPHABETS, Frederick Lambert. 110 sets 
of capital letters; 16 lower case alphabets; 70 sets of numbers and other symbols. 
110pp. 8% x 11. 22872-X Pa. $4.50 


ORCHIDS AS HOUSE PLANTS, Rebecca Tyson Northen. Grow cattleyas and 
many other kinds of orchids—in a window, in a case, or under artificial light. 63 
illustrations. 148pp. 5% x 8%. 23261-1 Pa. $2.95 


THE MUSHROOM HANDBOOK, Louis C.C. Krieger. Still the best popular 
handbook. Full descriptions of 259 species, extremely thorough text, poisons, 
folklore, etc. 32 color plates; 126 other illustrations. 560pp. 5% x 8%. 

21861-9 Pa. $8.50 


THE DORE BIBLE ILLUSTRATIONS, Gustave Doré. All wonderful, detailed 
plates: Adam and Eve, Flood, Babylon, life of Jesus, etc. Brief King James text with 
each plate. 241 plates. 241pp. 9 x 12. 23004-X Pa. $8.95 


THE BOOK OF KELLS: Selected Plates in Full Color, edited by Blanche Cirker. 32 
full-page plates from greatest manuscript-icon of early Middle Ages. Fantastic, 
mysterious. Publisher’s Note. Captions. 32pp. 9% x 124%. 24345-1 Pa. $4.50 


THE PERFECT WAGNERITE, George Bernard Shaw. Brilliant criticism of the 
Ring Cycle, with provocative interpretation of politics, economic theories behind 
the Ring. 136pp. 5% x 8%. (Available in U.S. only) 21707-8 Pa. $3.00 
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CHANCERY CURSIVE STROKE BY STROKE, Arthur Baker. Instructions and 
illustrations for each stroke of each letter (upper and lower case) and numerals. 54 
full-page plates. 64pp. 8% x 11. 24278-1 Pa. $2.50 


THE ENJOYMENT AND USE OF COLOR, Walter Sargent. Color relationships, 
values, intensities; complementary colors, illumination, similar topics. Color in 
nature and art. 7 color plates, 29 illustrations. 274pp. 5% x 8%. 20944-X Pa. $4.95 


SCULPTURE PRINCIPLES AND PRACTICE, Louis Slobodkin. Step-by-step 
approach to clay, plaster, metals, stone; classical and modern. 253 drawings, 
photos. 255pp. 8% x 11. 22960-2 Pa. $7.50 


VICTORIAN FASHION PAPER DOLLS FROM HARPER’S BAZAR, 1867-1898, 
Theodore Menten. Four female dolls with 28 elegant high fashion costumes, 
printed in full color. 32pp. 9% x 12%. 23453-3 Pa. $3.50 


FLOPSY, MOPSY AND COTTONTAIL: A Little Book of Paper Dolls in Full 
Color, Susan LaBelle. Three dolls and 21 costumes (7 for each doll) show Peter 
Rabbit’s siblings dressed for holidays, gardening, hiking, etc. Charming borders, 
captions. 48pp. 4% x 5%. 24376-1 Pa. $2.25 


NATIONAL LEAGUE BASEBALL CARD CLASSICS, Bert Randolph Sugar. 83 
big-leaguers from 1909-69 on facsimile cards. Hubbell, Dean, Spahn, Brock plus 
advertising, info, no duplications. Perforated, detachable. 16pp. 8% x 11. 

24308-7 Pa. $2.95 


THE LOGICAL APPROACH TO CHESS, Dr. Max Euwe, et al. First-rate text of 
comprehensive strategy, tactics, theory for the amateur. No gambits to memorize, 
just a clear, logical approach. 224pp. 5% x 8%. 24353-2 Pa. $4.50 


MAGICK IN THEORY AND PRACTICE, Aleister Crowley. The summation of 
the thought and practice of the century’s most famous necromancer, long hard to 
find. Crowley’s best book. 436pp. 5% x 8%. (Available in U.S. only) 

23295-6 Pa. $6.50 


THE HAUNTED HOTEL, Wilkie Collins. Collins’ last great tale; doom and 
destiny in a Venetian palace. Praised by T.S. Eliot. 127pp. 5% x 8%. 
24333-8 Pa. $3.00 


ART DECO DISPLAY ALPHABETS, Dan X. Solo. Wide variety of bold yet 
elegant lettering in handsome Art Deco styles. 100 complete fonts, with numerals, 
punctuation, more. 104pp. 8% x 11. 24372-9 Pa. $4.50 


CALLIGRAPHIC ALPHABETS, Arthur Baker. Nearly 150 complete alphabets by 
outstanding contemporary. Stimulating ideas; useful source for unique effects. 154 
plates. 157pp. 8% x 11%. 21045-6 Pa. $5.95 


ARTHUR BAKER’S HISTORIC CALLIGRAPHIC ALPHABETS, Arthur 

Baker. From monumental capitals of first-century Rome to humanistic cursive of 

16th century, 33 alphabets in fresh interpretations. 88 plates. 96pp. 9 x 12. 
24054-1 Pa. $4.50 


LETTIE LANE PAPER DOLLS, Sheila Young. Genteel turn-of-the-century 
family very popular then and now. 24 paper dolls. 16 plates in full color. 32pp. 9% x 
12%. 24089-4 Pa. $3.50 
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THE BOOK OF WOOD CARVING, Charles Marshall Sayers. Still finest book for 
beginning student. Fundamentals, technique; gives 34 designs, over 34 projects for 
panels, bookends, mirrors, etc. 33 photos. 118pp. 7% x 10%. 23654-4 Pa. $3.95 


CARVING COUNTRY CHARACTERS, Bill Higginbotham. Expert advice for 

beginning, advanced carvers on materials, techniques for creating 18 projects— 

mirthful panorama of American characters. 105 illustrations. 80pp. 8% x 11. 
24135-1 Pa. $2.50 


300 ART NOUVEAU DESIGNS AND MOTIFS IN FULL COLOR, C.B. Grafton. 
44 full-page plates display swirling lines and muted colors typical of Art Nouveau. 
Borders, frames, panels, cartouches, dingbats, etc. 48pp. 9% x 12%. 

24354-0 Pa. $6.95 


SELF-WORKING CARD TRICKS, Karl Fulves. Editor of Pallbearer offers 72 
tricks that work automatically through nature of card deck. No sleight of hand 
needed. Often spectacular. 42 illustrations. 113pp. 5% x 8%. 23334-0 Pa. $3.50 


CUT AND ASSEMBLE A WESTERN FRONTIER TOWN, Edmund V. Gillon, 
Jr. Ten authentic full-color buildings on heavy cardboard stock in H-O scale. 
Sheriff’s Office and Jail, Saloon, Wells Fargo, Opera House, others. 48pp. 9% x 12%. 

23736-2 Pa. $3.95 


CUT AND ASSEMBLE AN EARLY NEW ENGLAND VILLAGE, Edmund V. 
Gillon, Jr. Printed in full color on heavy cardboard stock. 12 authentic buildings in 
H-O scale: Adams home in Quincy, Mass., Oliver Wight house in Sturbridge, 
smithy, store, church, others. 48pp. 9% x 12%. 23536-X Pa. $4.95 


THE TALE OF TWO BAD MICE, Beatrix Potter. Tom Thumb and Hunca Munca 
squeeze out of their hole and go exploring. 27 full-color Potter illustrations. 59pp. 
4% x 5%. (Available in U.S. only) 23065-1 Pa. $1.75 


CARVING FIGURE CARICATURES IN THE OZARK STYLE, Harold L. 
Enlow. Instructions and illustrations for ten delightful projects, plus general 
carving instructions. 22 drawings and 47 photographs altogether. 39pp. 8% x 11. 
23151-8 Pa. $2.50 
A TREASURY OF FLOWER DESIGNS FOR ARTISTS, EMBROIDERERS 
AND CRAFTSMEN, Susan Gaber. 100 garden favorites lushly rendered by artist 
for artists, craftsmen, needleworkers. Many form frames, borders. 80pp. 8% x 11. 
24096-7 Pa. $3.50 


CUT & ASSEMBLE A TOY THEATER/THE NUTCRACKER BALLET, Tom 

Tierney. Model of a complete, full-color production of Tchaikovsky’s classic. 6 

backdrops, dozens of characters, familiar dance sequences. 32pp. 9% x 12%. 
24194-7 Pa. $4.50 


ANIMALS: 1,419 COPYRIGHT-FREE ILLUSTRATIONS OF MAMMALS, 

BIRDS, FISH, INSECTS, ETC., edited by Jim Harter. Clear wood engravings 

present, in extremely lifelike poses, over 1,000 species of animals. 284pp. 9 x 12. 
23766-4 Pa. $9.95 


? 
MORE HAND SHADOWS, Henry Bursill. For those at their ‘finger ends,” 16 more 
effects—Shakespeare, a hare, a squirrel, Mr. Punch, and twelve more—each 
explained by a full-page illustration. Considerable period charm. 30pp. 6% x 9%. 
21384-6 Pa. $1.95 
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THE PRINCIPLE OF RELATIVITY, Albert Einstein et al. Eleven most impor- 
tant original papers on special and general theories. Seven by Einstein, two by 
Lorentz, one each by Minkowski and Weyl. 216pp. 5% x 8%. 60081-5 Pa. $4.00 


PINEAPPLE CROCHET DESIGNS, edited by Rita Weiss. The most popular 
crochet design. Choose from doilies, luncheon sets, bedspreads, apron—3¢4 in all. 32 
photographs. 48pp. 8% x 11. 23939-X Pa. $2.00 


REPEATS AND BORDERS IRON-ON TRANSFER PATTERNS, edited by Rita 
Weiss. Lovely florals, geometrics, fruits, animals, Art Nouveau, Art Deco and more. 
48pp. 8% x 11. 23428-2 Pa. $1.95 


SCIENCE-FICTION AND HORROR MOVIE POSTERS IN FULL COLOR, 
edited by Alan Adler. Large, full-color posters for 46 films including King Kong, 
Godzilla, The Illustrated Man, and more. A bug-eyed bonanza of scantily clad 
women, monsters and assorted other creatures. 48pp. 10% x 14%. 23452-5 Pa. $8.95 


TECHNICAL MANUAL AND DICTIONARY OF CLASSICAL BALLET, Gail 
Grant. Defines, explains, comments on steps, movements, poses and concepts. 
15-page pictorial section. Basic book for student, viewer. 127pp. 5% x 8%. 

21843-0 Pa. $2.95 
STORYBOOK MAZES, Dave Phillips. 23 stories and mazes on two-page spreads: 
Wizard of Oz, Treasure Island, Robin Hood, etc. Solutions. 64pp. 8% x 11. 

23628-5 Pa. $2.25 
PUNCH-OUT PUZZLE KIT, K. Fulves. Engaging, self-contained space age 
entertainments. Ready-to-use pieces, diagrams, detailed solutions. Challenge a 
robot, split the atom, more. 40pp. 8% x 11. 24307-9 Pa. $3.50 


THE HUMAN FIGURE IN MOTION, Eadweard Muybridge. Over 4500 19th- 
century photos showing stopped-action sequences of undraped men, women, 
children jumping, running, sitting, other actions. Monumental collection. 390pp. 
Th X 10%. 20204-6 Clothbd. $18.95 


PHOTOGRAPHIC SKETCHBOOK OF THE CIVIL WAR, Alexander Gardner. 
Reproduction of 1866 volume with 100 on-the-field photographs: Manassas, 
Lincoln on battlefield, slave pens, etc. 224pp. 10% x 8%. 22731-6 Pa. $7.95 


FLORAL IRON-ON TRANSFER PATTERNS, edited by Rita Weiss. 55 floral 
designs, large and small, realistic, stylized; poppies, iris, roses, etc. Victorian, 
modern. Instructions. 48pp. 8% x 11. 23248-4 Pa. $1.95 


AUTOBIOGRAPHY: The Story of My Experiments with Truth, Mohandas K. 
Gandhi. Boyhood, legal studies, purification, the growth of the Satyagraha 
(nonviolent protest) movement. Critical, inspiring work of the man who freed 
India. 480pp. 5% x 8%. 24593-4 Pa. $6.95 


ON THE IMPROVEMENT OF THE UNDERSTANDING, Benedict Spinoza. 
Also contains Ethics, Correspondence, all in excellent R Elwes translation. Basic 
works on eniry to philosophy, pantheism, exchange of ideas with great contempo- 
raries. 420pp. 5% x 8%. 20250-X Pa. $5.95 


Prices subject to change without notice. 
Available at your book dealer or write for free catalog to Dept. GI, Dover 
Publications, Inc., 3] East 2nd St. Mineola, N.Y. 11501. Dover publishes more than 
175 books each year on science, elementary and advanced mathematics, biology, 
music, art, literary history, social sciences and other areas. 
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SPECIAL FUNCTIONS AND THEIR APPLICATIONS, N.N. Lebedev. (60624-4) 


WORKED PROBLEMS IN APPLIED MATHEMATICS, N.N. Lebedev, I.P. Skalska- 
ya and Y.S. Uflyand. (63730-1) $7.00 


APPLICATIONS OF TENSOR ANALYSIS, A.J. McConnell. (60373-3) $6.50 
FUNDAMENTAL CONCEPTS OF ALGEBRA, Bruce E. Meserve. (61470-0) $6.00 


BUN ar CONCEPTS OF GEOMETRY, Bruce E. Meserve. (63415-4) 

7.5 

NUMERICAL SOLUTION OF DIFFERENTIAL EQUATIONS, William E. Milne. 
(62437-4) $7.00 

AN INTRODUCTION TO LINEAR ALGEBRA, L. Mirsky. (61547-2) $8.00 

TABLES OF INDEFINITE INTEGRALS, G. Petit Bois. (60225-7) $6.00 

ask AND TRANSFORMATIONS, Anthony J. Pettofrezzo. (63634-8) 

CONCEPTS OF PROBABILITY THEORY, Paul E. Pfeiffer. (63677-1) $7.50 

THE eae THEORY OF Geopesics, M.: M. Postnikov. (63166-4) 

PROBABILITY THEORY; A Concise Course, Y.A. Rozanov. (63544-9) $4.00 

ORDINARY DIFFERENTIAL EQUATIONS AND STABILITY THEORY: AN INTRODUC- 
TION, David A. Sánchez. (63828-6) 

GEOMETRY OF COMPLEX NumMeBeRs, Hans Schwerdtfeger. (63830-8) $5.00 

INTEGRAL, MEASURE AND DeriIvaATIVE, Georgi E. Shilov and B.L. Gurevich. 
(63519-8) $5.00 

LINEAR ALGEBRA, Georgi E. Shilov. (63518-X) $6.95 

PROBLEMS IN PROBABILITY THEORY, MATHEMATICAL STATISTICS AND THEORY 
OF RANDOM Functions, A.A. Sveshnikov. (63717-4) $8.50 

TENSOR CALCULUS, J.L. Synge and A. Schild. (63612-7) $6.00 

SEQUENTIAL ANALYSIS, Abraham Wald. (61579-0) $5.50 

CALCULUS OF VARIATIONS WITH APPLICATIONS TO PHYSICS AND ENGINEERING, 
Robert Weinstock. (63069-2) $6.50 A 

INTRODUCTION TO VECTOR AND TENSOR ANALYSIS, Robert C. Wrede. 
(61879-X) $7.50 


Paperbound unless otherwise indicated. Prices subject to change without 
notice. Available at your book dealer or write for free catalogues to Dept. 
Mathematics, Dover Publications, Inc., 31 East 2nd Street, Mineola, N. 
Y. 11501. Please indicate field of interest. Each year Dover publishes 
over 200 books on fine art, music, crafts and needlework, antiques, lan- 
guages, literature, children’s books, chess, cookery, nature, anthropology, 
science, mathematics, and other areas. 


Manufactured in the U.S.A. 


